-- Logs begin at Wed 2022-11-02 13:46:47 UTC, end at Wed 2022-11-02 15:04:37 UTC. -- Nov 02 14:30:09.124490 dv-cinder-862365-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 02 14:30:09.132910 dv-cinder-862365-4-iscsi devstack@n-api.service[104604]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 02 14:30:09.137146 dv-cinder-862365-4-iscsi devstack@n-api.service[104604]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Nov 2 14:30:09 2022] *** Nov 02 14:30:09.137146 dv-cinder-862365-4-iscsi devstack@n-api.service[104604]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 02 14:30:09.137146 dv-cinder-862365-4-iscsi devstack@n-api.service[104604]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 02 14:30:09.137146 dv-cinder-862365-4-iscsi devstack@n-api.service[104604]: nodename: dv-cinder-862365-4-iscsi Nov 02 14:30:09.137146 dv-cinder-862365-4-iscsi devstack@n-api.service[104604]: machine: x86_64 Nov 02 14:30:09.137146 dv-cinder-862365-4-iscsi devstack@n-api.service[104604]: clock source: unix Nov 02 14:30:09.137146 dv-cinder-862365-4-iscsi devstack@n-api.service[104604]: pcre jit disabled Nov 02 14:30:09.137146 dv-cinder-862365-4-iscsi devstack@n-api.service[104604]: detected number of CPU cores: 4 Nov 02 14:30:09.137146 dv-cinder-862365-4-iscsi devstack@n-api.service[104604]: current working directory: / Nov 02 14:30:09.137146 dv-cinder-862365-4-iscsi devstack@n-api.service[104604]: detected binary path: /usr/bin/uwsgi-core Nov 02 14:30:09.137146 dv-cinder-862365-4-iscsi devstack@n-api.service[104604]: your processes number limit is 47680 Nov 02 14:30:09.137146 dv-cinder-862365-4-iscsi devstack@n-api.service[104604]: your memory page size is 4096 bytes Nov 02 14:30:09.137146 dv-cinder-862365-4-iscsi devstack@n-api.service[104604]: detected max file descriptor number: 2048 Nov 02 14:30:09.137146 dv-cinder-862365-4-iscsi devstack@n-api.service[104604]: lock engine: pthread robust mutexes Nov 02 14:30:09.137146 dv-cinder-862365-4-iscsi devstack@n-api.service[104604]: thunder lock: enabled Nov 02 14:30:09.137146 dv-cinder-862365-4-iscsi devstack@n-api.service[104604]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 02 14:30:09.137146 dv-cinder-862365-4-iscsi devstack@n-api.service[104604]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Nov 02 14:30:09.177866 dv-cinder-862365-4-iscsi devstack@n-api.service[104604]: Python main interpreter initialized at 0x55f6d86d59c0 Nov 02 14:30:09.177866 dv-cinder-862365-4-iscsi devstack@n-api.service[104604]: python threads support enabled Nov 02 14:30:09.177866 dv-cinder-862365-4-iscsi devstack@n-api.service[104604]: your server socket listen backlog is limited to 100 connections Nov 02 14:30:09.177866 dv-cinder-862365-4-iscsi devstack@n-api.service[104604]: your mercy for graceful operations on workers is 90 seconds Nov 02 14:30:09.178386 dv-cinder-862365-4-iscsi devstack@n-api.service[104604]: mapped 403077 bytes (393 KB) for 2 cores Nov 02 14:30:09.178386 dv-cinder-862365-4-iscsi devstack@n-api.service[104604]: *** Operational MODE: preforking *** Nov 02 14:30:09.178607 dv-cinder-862365-4-iscsi devstack@n-api.service[104604]: *** uWSGI is running in multiple interpreter mode *** Nov 02 14:30:09.178607 dv-cinder-862365-4-iscsi devstack@n-api.service[104604]: spawned uWSGI master process (pid: 104604) Nov 02 14:30:09.178817 dv-cinder-862365-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 02 14:30:09.179811 dv-cinder-862365-4-iscsi devstack@n-api.service[104604]: spawned uWSGI worker 1 (pid: 104605, cores: 1) Nov 02 14:30:09.180246 dv-cinder-862365-4-iscsi devstack@n-api.service[104604]: spawned uWSGI worker 2 (pid: 104606, cores: 1) Nov 02 14:30:09.180445 dv-cinder-862365-4-iscsi devstack@n-api.service[104604]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 02 14:30:09.878329 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Nov 02 14:30:09.890837 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Nov 02 14:30:10.997541 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 14:30:10.997541 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: from cryptography.utils import int_from_bytes Nov 02 14:30:10.998238 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 14:30:10.998238 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: from cryptography.utils import int_from_bytes Nov 02 14:30:11.000976 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 14:30:11.000976 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: from cryptography.utils import int_from_bytes Nov 02 14:30:11.001541 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 14:30:11.001541 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: from cryptography.utils import int_from_bytes Nov 02 14:30:13.570314 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 14:30:13.570962 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 14:30:13.571180 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 14:30:13.571546 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 14:30:13.571804 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 14:30:13.572194 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.572522 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.572848 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.573202 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.573547 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.573855 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.574179 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.574498 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.574827 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.575094 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.575408 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.575732 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-862365-4-iscsi {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.576054 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.576188 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 14:30:13.576649 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 14:30:13.576781 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.576781 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.577041 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 14:30:13.577182 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.577312 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 14:30:13.577447 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.577565 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 14:30:13.577714 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.577886 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.578022 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.578218 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.578382 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.578546 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.578819 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.578957 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.579126 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.579246 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.579438 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.579576 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.579780 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.579895 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.580232 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.580397 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.580548 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.580704 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.580844 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.580968 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.581136 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.581264 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.581383 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.581545 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-862365-4-iscsi {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.581687 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.581807 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.582061 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.582255 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-862365-4-iscsi {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.582373 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.582484 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.582691 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.582846 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.583001 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.583137 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.583328 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.583432 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.583644 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.583780 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.584028 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.584151 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.584351 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.584477 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.584674 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.584843 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.585187 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.585899 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.586083 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.586254 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.586453 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.586645 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.586774 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.586912 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.587070 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.587210 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.587387 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.587535 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.587774 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.587920 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.588177 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.588373 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.588532 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.588652 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.588944 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.589111 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-862365-4-iscsi {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.589242 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.589363 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.589551 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.589673 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.589918 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.590055 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.590248 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.590383 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.590575 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.590710 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.590841 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.591029 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.591178 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.591306 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.591426 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.591590 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.591761 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.591893 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.592014 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.592229 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.592367 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.592554 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.592675 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.592885 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.593052 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.593236 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.593357 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.593540 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.593669 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.593847 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.593984 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.594152 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.594274 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.594474 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.594596 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.594786 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.594909 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.595094 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.595215 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.595346 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.595466 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.595644 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.595765 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.595971 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.596234 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.596381 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.596574 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.596703 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.596838 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.596964 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.597136 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.597257 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.597380 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.597510 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.597679 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.597810 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.597930 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.598230 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.598414 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.598524 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.598629 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.598834 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.599026 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.599147 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.599267 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.599445 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.599579 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.599756 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.599874 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.600068 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.600190 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.600315 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.600429 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.600643 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.600811 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.601071 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.601317 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.601443 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.601694 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.601894 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.602031 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.602297 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.602419 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.602598 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.602735 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.602906 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.603212 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.603334 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.603516 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.603636 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.603819 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.603939 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.604123 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.604245 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.604431 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.604557 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.604735 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.604857 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.605066 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.605204 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.605373 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.605755 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.605935 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.606056 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.606259 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.606383 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.606571 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.606707 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.606886 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.607055 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.607187 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.607400 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.607523 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.607752 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.607873 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.607993 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.608110 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.608300 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.608421 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.608642 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.608761 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.608965 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.609274 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.609397 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.609519 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.609661 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.610047 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.610223 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.610387 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.610544 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.610723 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.610894 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.611014 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.611140 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.611271 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.611447 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.611575 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.611706 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.611826 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.611946 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.612064 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.612183 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.612325 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.612442 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.612562 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.612680 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.612800 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.612938 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.613156 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.613277 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.613397 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.613516 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.613637 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.613758 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.613894 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.614015 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.614209 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.614331 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.614595 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.614726 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.614911 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.615044 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.615213 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.615336 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.615520 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.615642 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.615825 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.615948 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.616145 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.616311 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.616515 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.616689 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.616867 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.616986 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.617210 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.617532 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.617654 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.617870 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.617995 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.618227 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.618350 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.618545 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.618666 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.618859 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.618992 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.619174 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.619307 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.619506 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.619658 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.619814 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.619946 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.620123 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.620244 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.620432 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.620564 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.620750 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.620927 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.621076 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.621218 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.621390 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.621522 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.621705 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.621838 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.622015 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.622145 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.622321 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.622454 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.622626 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.622758 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.622943 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.623083 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.623271 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.623411 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.623584 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.623724 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.623892 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.624012 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.624248 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.624370 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.624564 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.624689 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:30:13.624876 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.625119 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.625254 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.625390 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.625536 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.625659 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.625844 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.625966 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.626151 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.626292 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.626459 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.626583 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.626805 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.626984 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.627126 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.627307 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.627481 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.627675 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.627794 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.627933 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.628075 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.628195 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.628329 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.628506 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.628630 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.628828 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.628965 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.629182 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.629320 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.629511 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.629688 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.629850 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.629986 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.630172 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.630294 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.630492 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.630613 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.630816 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.630944 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.631130 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.631255 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.631437 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.631560 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.634480 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.634669 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.634798 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.634943 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.635063 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.635186 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.635325 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.635325 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.635552 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.635683 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.635818 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.635941 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.636077 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.636196 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.636320 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.636463 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.636591 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.636724 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.636844 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.636964 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.637103 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.637224 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.637345 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.637491 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.637669 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.637796 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.637921 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.638058 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.638179 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.638322 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.638322 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.638550 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.638674 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.638790 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.638912 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.639044 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.639176 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.639299 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.639423 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.639547 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.639547 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.639840 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.639975 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.640102 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.640102 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.640338 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.640474 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.640595 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.640735 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.640855 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.640977 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.641213 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.641347 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.641468 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.641591 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.641714 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.641837 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.642017 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.642162 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.642293 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.642421 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.642544 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.642666 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.642802 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.642923 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.643046 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.643171 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.643293 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.643415 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.643550 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.643672 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.643795 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.643918 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.644045 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.644168 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.644310 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.644430 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.644569 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.644721 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.644906 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.645068 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.645384 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.645506 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.645692 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.646034 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.646154 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.646343 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.646603 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.646726 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.646953 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.647169 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.647363 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.647624 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.648316 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.648447 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.648709 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.648876 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.649057 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.649369 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.649502 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.649674 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.649978 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.650108 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.650285 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.650611 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.650734 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.650921 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.651217 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.651345 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.651593 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.651776 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.651901 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.652118 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.652262 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.652459 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.652595 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.652790 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.652921 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.653141 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.653287 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.653455 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.653589 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.653769 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.653902 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.654080 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.654212 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.654403 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.654543 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.654715 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.654839 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.655039 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.655166 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.655345 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.655478 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.655663 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.655787 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.655972 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.656093 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.656292 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.656426 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.656610 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.656770 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.656925 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.657105 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.657290 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.657471 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.657630 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.657755 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.657945 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.658066 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.658263 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.658384 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.658575 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.658711 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.658879 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.659012 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.659189 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.659321 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.659497 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.659619 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.659807 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.659942 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.660123 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.660253 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.660439 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.660575 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.660795 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.660936 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.661136 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.661257 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.661466 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.661602 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.661792 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.661927 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.662102 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.662224 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.662405 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.662540 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.662707 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.662843 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.663016 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.663259 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.663471 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.663668 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.663803 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.664106 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.664228 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.664470 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.664595 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.664794 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.664941 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.665130 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.665279 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.665443 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.665605 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.665753 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.665930 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.666052 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.666250 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.666373 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.666571 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.666694 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.666890 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.667012 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.667246 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.667383 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.667589 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.667730 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.667890 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.668022 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.668205 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.668328 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.668520 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.668678 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.668824 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.668960 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.669161 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.669278 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.669451 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.669597 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.669775 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.669898 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.670087 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.670207 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.670412 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.670559 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.670739 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.670902 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.671040 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.671233 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.671353 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.671489 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.671642 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.671766 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.671949 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.672071 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.672254 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.672377 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.672559 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.672697 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.672848 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.672969 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.673216 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.673342 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.673548 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.673673 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.673865 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.673987 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.674177 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.674298 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.674486 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.674608 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.674797 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.674928 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.675112 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.675234 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.675420 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.675543 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.675727 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.675860 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.676043 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.676177 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.676353 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.676474 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.676661 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.676797 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.676973 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.677194 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.677319 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.677444 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.677613 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.677816 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.677970 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.678092 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.678216 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.678339 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.678524 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.678659 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.679221 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.679340 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.679340 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.679576 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.679786 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.679786 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.680017 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.680137 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.680260 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.680453 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.680627 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.680752 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.680965 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.681116 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.681306 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.681444 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.681624 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.681747 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.681972 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.682107 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.682294 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.682426 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.682618 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.682804 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.682942 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.683065 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.683236 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.683360 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.683565 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.683706 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.683892 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.684016 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.684204 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.684339 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.684509 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.684643 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.684819 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.684941 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.685147 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.685271 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.685455 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.685587 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.685757 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.685888 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.686066 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.686200 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.686368 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.686490 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.686673 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.686796 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.686989 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.687138 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.687316 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.687438 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.687638 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.687759 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.687941 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.688063 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.688244 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.688367 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.688550 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.688684 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.688861 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.689129 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.689302 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.689420 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.689547 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.689682 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.689803 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.689942 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.690091 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.690222 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.690426 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.690609 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.690731 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.690870 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.691042 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.691195 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.691368 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.691489 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.691676 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.691809 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.691990 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.692113 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.692297 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.692439 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.692688 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.692892 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.693043 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.693311 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.693432 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.693853 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.693996 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.694221 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.694896 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.695333 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.695457 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.695759 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.695910 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.696159 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.696300 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.696489 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.696632 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.696831 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.697068 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.697215 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.697393 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.697518 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.697746 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.697876 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.698108 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.698279 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.698424 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.698554 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.698822 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.698951 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.699148 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.699346 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.699469 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.699711 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.699847 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.700084 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.700224 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.700362 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.700487 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.700661 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.700790 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.700967 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.701188 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.701311 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.701501 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.701634 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.701848 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.701970 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.702160 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.702298 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.702509 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.702633 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.702857 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.703053 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.703187 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.703313 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.703490 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.703624 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.703799 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.703943 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.704146 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.704271 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.704457 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.704591 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.704806 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.704945 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.705180 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.705305 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.705525 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.705649 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.705858 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.706078 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.706213 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.706335 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.706503 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.706634 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.706811 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.706934 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.707122 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.707256 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.707434 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.707556 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.707751 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.707902 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.708057 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.708194 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.708369 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.708496 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.708673 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.708795 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.709165 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.709357 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.709488 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.709630 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.709771 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.710118 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.710273 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.710407 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.710547 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.710687 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.710809 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.710930 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.711050 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.711169 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.711411 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.711550 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.711732 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.711862 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.712050 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.712178 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.712353 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.712499 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.712660 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.712788 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.713032 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.713223 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.713362 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.713496 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.713660 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.713783 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.713970 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.714092 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.714283 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.714405 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.714590 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.714725 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.714901 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.715030 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.715213 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.715331 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.715525 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.715662 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.715828 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.715967 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.716141 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.716263 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.716455 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.716592 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.716761 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.716894 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.717088 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.717211 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.717394 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.717518 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.717722 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.717856 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.718036 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.718164 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.718350 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.718482 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.718668 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.718811 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.718989 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.719115 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.719315 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.719491 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.719631 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.719766 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.719914 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.720037 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.720222 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.720356 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.720529 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.720666 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.720839 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.720961 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.721166 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.721284 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.721474 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.721607 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.721783 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.721917 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.722093 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.722227 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.722398 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.722520 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.722705 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.722826 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.723014 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.723141 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.723320 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.723449 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.723623 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.723746 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.723928 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.724051 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.724237 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.724358 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.724549 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.724690 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.724847 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.724984 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.725183 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.725362 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.725482 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.726149 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.726447 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.726693 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.726829 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.727232 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.727364 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.727551 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.727673 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.727864 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.727987 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.728174 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.728307 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.728487 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.728615 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.728796 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.728930 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.729138 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.729287 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.729456 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.729613 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.729761 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.729927 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.730169 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.730295 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.730734 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.730878 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.731067 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.731256 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.731394 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.731630 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.731754 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.731953 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.732081 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.732266 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.732387 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.732591 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.732713 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.732896 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.733041 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.733230 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.733360 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.733537 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.733711 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.733852 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.733971 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.734148 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.734269 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.734470 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.734674 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.734831 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.734949 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.735107 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.735231 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.735422 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.735559 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.735740 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.735876 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.736171 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.736304 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.736560 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.736776 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.736897 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.737062 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.737196 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.737320 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.737445 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.737587 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.737709 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.737835 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.737960 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.738135 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.738271 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.738445 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.738579 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.738770 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.738911 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.739090 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.739226 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.739401 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.739524 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.739717 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.739860 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.740017 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.740151 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.740341 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.740464 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.740663 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.740785 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.740974 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.741194 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.741458 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.741592 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.742042 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.742175 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.742370 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.742594 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.742720 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.742926 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.743070 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.743250 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.743390 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.743547 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.743688 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.743888 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.744015 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.744193 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.744318 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.744496 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.744641 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.744803 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.744936 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.745148 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.745274 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.745454 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.745597 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.745766 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.745890 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.746075 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.746199 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.746380 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.746516 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.746685 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.746808 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.746990 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.747127 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.747329 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.747453 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.747584 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.747778 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.747973 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.748096 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.748289 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.748524 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.748657 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.748845 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.748978 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.749184 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.749339 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.749553 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.749687 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.749865 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.749996 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.750163 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.750301 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.750470 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.750603 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.750773 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.750974 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.751123 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.751245 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.751405 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.751530 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.751727 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.751849 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.752041 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.752180 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.752365 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.752489 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.752675 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.752797 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.752995 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.753300 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.753424 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.753543 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.753677 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.753813 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.753980 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.754125 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.754297 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.754421 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.754623 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.754759 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.754927 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.755061 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.755230 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.755354 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.755540 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.755685 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.755843 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.755968 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.756143 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.756276 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.756446 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.756603 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.756759 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.757443 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.757598 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.757736 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.757900 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.758202 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.758325 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.758722 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.758846 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.759044 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.759197 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.759391 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.759517 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.759699 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.759824 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.760007 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.760152 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.760306 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.760429 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.760613 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.760793 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.760913 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.761091 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.761224 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.761355 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.761554 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.761679 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.761864 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.761987 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.762190 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.762316 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.762503 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.762626 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.762816 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.762939 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.763132 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.763257 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.763440 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.763561 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.763751 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.763870 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.764059 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.764233 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.764354 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.764479 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.764654 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.764779 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.764962 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.765110 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.765320 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.765442 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.765631 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.765757 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.765951 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.766197 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.766320 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.766529 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.766671 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.766841 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.766985 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.767150 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.767293 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.767453 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.767594 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.767754 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.767888 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.768068 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.768195 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.768380 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.768509 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.768692 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.768821 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.769058 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.769218 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.769446 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.769525 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.769680 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.769777 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.769986 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.770085 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.770297 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.770393 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.770604 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.770690 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.770912 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.771054 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.771219 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.771341 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.771525 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.771614 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.771829 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.771918 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.772155 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.772294 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.772614 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.772762 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.772902 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.773297 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.773441 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.773754 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.773951 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.774089 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.774237 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.774429 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.774556 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.774683 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.774770 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.774997 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.775118 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.775314 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.775523 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.775673 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.775816 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.775970 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.776110 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.776281 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.776463 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.776610 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.776794 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.776941 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.777150 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.777297 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.777475 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.777638 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.777875 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.777991 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.778129 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.778234 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.778415 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.778532 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.778740 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.779060 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.779179 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.779366 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.779453 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.779684 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.779779 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.780007 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.780101 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.780330 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.780572 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.780659 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.780909 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.781021 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.781257 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.781347 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.781576 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.781673 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.781881 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.781967 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.782191 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.782278 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.782501 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.782615 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.782805 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.782892 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.783118 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.783203 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.783422 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.783517 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.783730 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.783824 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.784051 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.784146 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.784356 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.784451 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.784695 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.784890 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.785112 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.785277 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.785379 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.785599 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.785686 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.785928 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.786022 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.786255 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.786354 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.786608 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.786706 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.786969 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.787064 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.787281 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.787368 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.787595 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.787688 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.787906 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.788000 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.788728 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.788859 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.789067 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.789379 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.789467 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.789691 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.789941 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.790042 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.790268 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.790364 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.790594 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.790681 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.790919 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.791006 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.791225 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.791324 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.791553 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.791703 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.791865 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.791979 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.792169 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.792296 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.792480 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.792625 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.792788 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.792982 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.793115 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.793355 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.793442 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.793681 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.793792 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.794006 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.794149 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.794316 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.794567 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.794656 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.794894 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.794980 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.795206 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.795292 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.795515 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.795604 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.795877 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.796031 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.796183 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.796280 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.796488 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.796576 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.796811 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.796898 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.797144 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.797237 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.797450 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.797538 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.797763 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.797883 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.798071 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.798182 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.798375 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.798469 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.798697 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.798783 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.799012 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.799124 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.799323 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.799459 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.799641 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.799729 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.799953 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.800193 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.800488 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.800587 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.800839 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.800977 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.801186 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.801346 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.801518 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.801664 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.801819 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.801902 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.802115 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.802204 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.802421 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.802522 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.802750 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.802892 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.803055 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.803145 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.803362 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.803449 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.803669 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.803881 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.804171 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.804288 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.804483 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.804764 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.804863 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.805105 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.805212 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.805420 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.805520 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.805730 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.805825 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.806036 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.806138 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.806348 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.806447 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.806652 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.806742 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.806961 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.807051 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.807268 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.807355 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.807575 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.807661 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.807953 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.808055 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.808203 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.808292 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.808511 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.808677 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.808820 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.809073 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.809166 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.809247 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.809453 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.809551 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.809760 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.809857 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.810066 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.810153 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.810380 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.810509 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.810687 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.810776 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.811003 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.811097 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.811319 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.811414 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.811627 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.811718 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.811950 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.812279 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.812377 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.812588 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.812684 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.812894 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.812989 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.813240 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.813341 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.813552 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.813639 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.813877 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.813971 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.814189 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.814328 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.814501 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.814587 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.814822 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.814910 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.815132 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.815222 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.815463 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.815705 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.815868 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.816046 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.816208 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.816372 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.816539 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.816705 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.816849 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.817066 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.817200 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.817385 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.817507 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.817698 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.817814 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.818010 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.818133 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.818338 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.818426 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.818653 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.818747 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.818971 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.819059 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.819287 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.820169 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.820169 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.820370 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.820475 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.820801 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.820907 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.821157 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.821250 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.821480 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.821583 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.821785 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.821875 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.822149 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.822256 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.822452 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.822546 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.822756 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.822872 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.823067 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.823178 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.823366 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.823457 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.823674 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.823761 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.823977 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.824072 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.824285 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.824417 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.824587 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.824709 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.824886 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.824974 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.825213 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.825332 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.825553 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.825659 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.825890 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.826028 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.826199 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.826295 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.826520 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.826611 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.826830 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.826926 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.827150 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.827244 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.827453 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.827539 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.827774 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.827927 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.828085 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.828202 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.828398 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.828704 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.828804 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.829068 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.829171 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.829379 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.829468 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.829688 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.829790 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.830000 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.830138 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.830305 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.830393 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.830611 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.830708 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.830916 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.831012 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.831245 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.831332 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.831566 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.831661 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.831872 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.831970 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.832196 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.832283 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.832510 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.832603 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.832828 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.832948 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.833165 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.833248 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.833479 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.833569 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.833790 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.833895 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.834106 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.834311 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.834467 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.834656 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.834815 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.835097 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.835237 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.835351 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.835575 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.835704 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.835919 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.836131 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.836333 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.836492 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.836582 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.836805 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.836903 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.837144 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.837238 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.837459 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.837548 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.837777 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.837881 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.838082 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.838178 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.838394 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.838494 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.838703 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.838806 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.839091 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.839279 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.839364 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.839444 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.839613 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.839702 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.839925 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.840035 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.840233 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.840322 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.840541 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.840629 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.840848 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.840946 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.841174 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 14:30:13.841263 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.841479 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.841817 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.842156 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.842473 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.842799 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.843114 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.843916 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.843916 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.844090 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.844834 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.844834 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.845046 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.845339 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.845649 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.845961 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.846276 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.846588 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.846898 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.847208 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.847538 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.847865 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.848174 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.848502 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.848824 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.849171 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.849491 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.849807 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.850139 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.850452 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.851300 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.851856 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.852318 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.852609 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.852932 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.853537 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.853676 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.853908 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.854231 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.854597 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.854905 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.855219 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.855803 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.856133 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.856485 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.856806 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.857178 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.857513 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.857836 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.858149 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.858461 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:30:13.858708 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 14:30:13.997565 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: INFO dbcounter [None req-9775dd72-f1f6-458c-aa9f-c67e026adcb1 None None] Registered counter for database nova_api Nov 02 14:30:14.016330 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: INFO dbcounter [None req-19cb4725-2462-46f8-899c-f272b04fe4f4 None None] Registered counter for database nova_api Nov 02 14:30:14.018541 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG oslo_db.sqlalchemy.engines [None req-9775dd72-f1f6-458c-aa9f-c67e026adcb1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104605) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 14:30:14.025978 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG dbcounter [-] [104605] Writer thread running {{(pid=104605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 14:30:14.037626 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG oslo_db.sqlalchemy.engines [None req-19cb4725-2462-46f8-899c-f272b04fe4f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104606) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 14:30:14.045307 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG dbcounter [-] [104606] Writer thread running {{(pid=104606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 14:30:14.083972 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.context [None req-9775dd72-f1f6-458c-aa9f-c67e026adcb1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8d61f910-ccfe-4a5e-a533-9675eb6757f8(cell1) {{(pid=104605) load_cells /opt/stack/nova/nova/context.py:464}} Nov 02 14:30:14.088594 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG oslo_concurrency.lockutils [None req-9775dd72-f1f6-458c-aa9f-c67e026adcb1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:14.089229 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG oslo_concurrency.lockutils [None req-9775dd72-f1f6-458c-aa9f-c67e026adcb1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:14.091653 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG oslo_concurrency.lockutils [None req-9775dd72-f1f6-458c-aa9f-c67e026adcb1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:14.092456 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG oslo_concurrency.lockutils [None req-9775dd72-f1f6-458c-aa9f-c67e026adcb1 None None] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:14.092897 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG oslo_concurrency.lockutils [None req-9775dd72-f1f6-458c-aa9f-c67e026adcb1 None None] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:14.095082 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG oslo_concurrency.lockutils [None req-9775dd72-f1f6-458c-aa9f-c67e026adcb1 None None] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:14.097383 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: INFO dbcounter [None req-9775dd72-f1f6-458c-aa9f-c67e026adcb1 None None] Registered counter for database nova_cell0 Nov 02 14:30:14.102462 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: INFO dbcounter [None req-9775dd72-f1f6-458c-aa9f-c67e026adcb1 None None] Registered counter for database nova_cell1 Nov 02 14:30:14.107775 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.context [None req-19cb4725-2462-46f8-899c-f272b04fe4f4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8d61f910-ccfe-4a5e-a533-9675eb6757f8(cell1) {{(pid=104606) load_cells /opt/stack/nova/nova/context.py:464}} Nov 02 14:30:14.112474 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG oslo_concurrency.lockutils [None req-19cb4725-2462-46f8-899c-f272b04fe4f4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:14.112730 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG oslo_db.sqlalchemy.engines [None req-9775dd72-f1f6-458c-aa9f-c67e026adcb1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104605) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 14:30:14.112952 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG oslo_concurrency.lockutils [None req-19cb4725-2462-46f8-899c-f272b04fe4f4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:14.114655 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG oslo_concurrency.lockutils [None req-19cb4725-2462-46f8-899c-f272b04fe4f4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:14.115413 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG oslo_concurrency.lockutils [None req-19cb4725-2462-46f8-899c-f272b04fe4f4 None None] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:14.115856 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG oslo_concurrency.lockutils [None req-19cb4725-2462-46f8-899c-f272b04fe4f4 None None] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:14.116897 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG oslo_db.sqlalchemy.engines [None req-9775dd72-f1f6-458c-aa9f-c67e026adcb1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104605) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 14:30:14.118760 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG oslo_concurrency.lockutils [None req-19cb4725-2462-46f8-899c-f272b04fe4f4 None None] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=104606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:14.120810 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: INFO dbcounter [None req-19cb4725-2462-46f8-899c-f272b04fe4f4 None None] Registered counter for database nova_cell0 Nov 02 14:30:14.124845 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG dbcounter [-] [104605] Writer thread running {{(pid=104605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 14:30:14.125014 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: INFO dbcounter [None req-19cb4725-2462-46f8-899c-f272b04fe4f4 None None] Registered counter for database nova_cell1 Nov 02 14:30:14.126324 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG dbcounter [-] [104605] Writer thread running {{(pid=104605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 14:30:14.133424 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG oslo_db.sqlalchemy.engines [None req-19cb4725-2462-46f8-899c-f272b04fe4f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104606) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 14:30:14.135182 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG oslo_db.sqlalchemy.engines [None req-19cb4725-2462-46f8-899c-f272b04fe4f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104606) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 14:30:14.140921 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG dbcounter [-] [104606] Writer thread running {{(pid=104606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 14:30:14.143635 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG dbcounter [-] [104606] Writer thread running {{(pid=104606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 14:30:14.286629 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: INFO dbcounter [None req-9775dd72-f1f6-458c-aa9f-c67e026adcb1 None None] Registered counter for database nova_cell0 Nov 02 14:30:14.299718 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG oslo_db.sqlalchemy.engines [None req-9775dd72-f1f6-458c-aa9f-c67e026adcb1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104605) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 14:30:14.306156 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG dbcounter [-] [104605] Writer thread running {{(pid=104605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 14:30:14.308513 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: INFO dbcounter [None req-19cb4725-2462-46f8-899c-f272b04fe4f4 None None] Registered counter for database nova_cell0 Nov 02 14:30:14.317945 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG oslo_db.sqlalchemy.engines [None req-19cb4725-2462-46f8-899c-f272b04fe4f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104606) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 14:30:14.324864 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG dbcounter [-] [104606] Writer thread running {{(pid=104606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 14:30:14.794829 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: WARNING keystonemiddleware.auth_token [None req-9775dd72-f1f6-458c-aa9f-c67e026adcb1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 14:30:14.802589 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: WARNING keystonemiddleware.auth_token [None req-9775dd72-f1f6-458c-aa9f-c67e026adcb1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 14:30:14.833804 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: WARNING keystonemiddleware.auth_token [None req-19cb4725-2462-46f8-899c-f272b04fe4f4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 14:30:14.842640 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: WARNING keystonemiddleware.auth_token [None req-19cb4725-2462-46f8-899c-f272b04fe4f4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 14:30:15.149722 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: WARNING keystonemiddleware.auth_token [None req-9775dd72-f1f6-458c-aa9f-c67e026adcb1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 14:30:15.155978 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: WARNING keystonemiddleware.auth_token [None req-9775dd72-f1f6-458c-aa9f-c67e026adcb1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 14:30:15.161395 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f6d86d59c0 pid: 104605 (default app) Nov 02 14:30:15.163790 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi [None req-9775dd72-f1f6-458c-aa9f-c67e026adcb1 None None] Calling method '>' {{(pid=104605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:15.164993 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: INFO nova.api.openstack.requestlog [None req-9775dd72-f1f6-458c-aa9f-c67e026adcb1 None None] 10.222.0.30 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002061 Nov 02 14:30:15.165430 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: [pid: 104605|app: 0|req: 1/1] 10.222.0.30 () {50 vars in 788 bytes} [Wed Nov 2 14:30:15 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:30:15.214796 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: WARNING keystonemiddleware.auth_token [None req-19cb4725-2462-46f8-899c-f272b04fe4f4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 14:30:15.221411 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: WARNING keystonemiddleware.auth_token [None req-19cb4725-2462-46f8-899c-f272b04fe4f4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 14:30:15.227628 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f6d86d59c0 pid: 104606 (default app) Nov 02 14:31:46.773210 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi [None req-9775dd72-f1f6-458c-aa9f-c67e026adcb1 None None] Calling method '>' {{(pid=104605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:46.774144 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: INFO nova.api.openstack.requestlog [None req-9775dd72-f1f6-458c-aa9f-c67e026adcb1 None None] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Nov 02 14:31:46.774553 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: [pid: 104605|app: 0|req: 2/2] 10.222.0.30 () {54 vars in 931 bytes} [Wed Nov 2 14:31:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:31:46.788499 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG dbcounter [-] [104606] Writing DB stats nova_api:SELECT=3 {{(pid=104606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:31:46.789487 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG dbcounter [-] [104606] Writing DB stats nova_cell0:SELECT=3 {{(pid=104606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:31:46.790774 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG dbcounter [-] [104606] Writing DB stats nova_cell1:SELECT=3 {{(pid=104606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:31:46.791717 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG dbcounter [-] [104606] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:31:47.761789 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi [None req-4353bc4e-ebad-49ec-9c9f-83b9b76575bc admin admin] Calling method '>' {{(pid=104606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:47.796786 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: INFO nova.api.openstack.requestlog [None req-4353bc4e-ebad-49ec-9c9f-83b9b76575bc admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.014477 Nov 02 14:31:47.797686 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: [pid: 104606|app: 0|req: 1/3] 10.222.0.30 () {60 vars in 1292 bytes} [Wed Nov 2 14:31:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:31:50.677130 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi [None req-9775dd72-f1f6-458c-aa9f-c67e026adcb1 None None] Calling method '>' {{(pid=104605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:50.678143 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: INFO nova.api.openstack.requestlog [None req-9775dd72-f1f6-458c-aa9f-c67e026adcb1 None None] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001536 Nov 02 14:31:50.678578 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: [pid: 104605|app: 0|req: 3/4] 10.222.0.30 () {54 vars in 931 bytes} [Wed Nov 2 14:31:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:31:51.210856 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi [None req-0aaf58f1-7bd5-4930-b98b-4e4eb93fda63 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "rxtx_factor": 1.0, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 1, "ram": 256, "vcpus": 1, "swap": 0}} {{(pid=104606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:31:51.351665 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: INFO nova.api.openstack.requestlog [None req-0aaf58f1-7bd5-4930-b98b-4e4eb93fda63 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.665485 Nov 02 14:31:51.352232 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: [pid: 104606|app: 0|req: 2/5] 10.222.0.30 () {64 vars in 1283 bytes} [Wed Nov 2 14:31:50 2022] POST /compute/v2.1/flavors => generated 407 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 14:31:51.366861 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG dbcounter [-] [104605] Writing DB stats nova_api:SELECT=3 {{(pid=104605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:31:51.367816 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG dbcounter [-] [104605] Writing DB stats nova_cell1:SELECT=3 {{(pid=104605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:31:51.368830 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG dbcounter [-] [104605] Writing DB stats nova_cell0:SELECT=3 {{(pid=104605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:31:51.369646 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG dbcounter [-] [104605] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:31:51.584562 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi [None req-f08ecca9-87e2-48d7-9dd4-0c099fb3b58a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:31:51.748609 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: INFO nova.api.openstack.requestlog [None req-f08ecca9-87e2-48d7-9dd4-0c099fb3b58a admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.387572 Nov 02 14:31:51.749516 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: [pid: 104605|app: 0|req: 4/6] 10.222.0.30 () {64 vars in 1336 bytes} [Wed Nov 2 14:31:51 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:31:54.681431 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi [None req-0aaf58f1-7bd5-4930-b98b-4e4eb93fda63 admin admin] Calling method '>' {{(pid=104606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:54.683487 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: INFO nova.api.openstack.requestlog [None req-0aaf58f1-7bd5-4930-b98b-4e4eb93fda63 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002931 Nov 02 14:31:54.684569 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: [pid: 104606|app: 0|req: 3/7] 10.222.0.30 () {54 vars in 931 bytes} [Wed Nov 2 14:31:54 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:31:55.639591 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi [None req-9a8aa425-b114-4910-8134-6d9bb23b2d06 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds512M", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "id": "d1"}} {{(pid=104605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:31:55.807957 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: INFO nova.api.openstack.requestlog [None req-9a8aa425-b114-4910-8134-6d9bb23b2d06 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.114295 Nov 02 14:31:55.809042 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: [pid: 104605|app: 0|req: 5/8] 10.222.0.30 () {64 vars in 1283 bytes} [Wed Nov 2 14:31:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 14:31:55.829382 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi [None req-5521880c-4c5e-4ea8-827b-b9f392705671 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:31:55.976132 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: INFO nova.api.openstack.requestlog [None req-5521880c-4c5e-4ea8-827b-b9f392705671 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.152762 Nov 02 14:31:55.977415 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: [pid: 104606|app: 0|req: 4/9] 10.222.0.30 () {64 vars in 1336 bytes} [Wed Nov 2 14:31:55 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:31:58.927570 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi [None req-9a8aa425-b114-4910-8134-6d9bb23b2d06 admin admin] Calling method '>' {{(pid=104605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:58.928643 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: INFO nova.api.openstack.requestlog [None req-9a8aa425-b114-4910-8134-6d9bb23b2d06 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001552 Nov 02 14:31:58.929065 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: [pid: 104605|app: 0|req: 6/10] 10.222.0.30 () {54 vars in 931 bytes} [Wed Nov 2 14:31:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:31:59.439127 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi [None req-4709c670-27bd-4791-a6c9-9421795351b3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "os-flavor-access:is_public": true, "ram": 1024, "name": "ds1G", "rxtx_factor": 1.0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1}} {{(pid=104606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:31:59.523979 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: INFO nova.api.openstack.requestlog [None req-4709c670-27bd-4791-a6c9-9421795351b3 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.587719 Nov 02 14:31:59.524544 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: [pid: 104606|app: 0|req: 5/11] 10.222.0.30 () {64 vars in 1283 bytes} [Wed Nov 2 14:31:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 14:31:59.537807 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi [None req-ad679708-e877-41bb-bbe1-18b6f681a8d2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:31:59.637842 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: INFO nova.api.openstack.requestlog [None req-ad679708-e877-41bb-bbe1-18b6f681a8d2 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.104207 Nov 02 14:31:59.638431 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: [pid: 104605|app: 0|req: 7/12] 10.222.0.30 () {64 vars in 1336 bytes} [Wed Nov 2 14:31:59 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:32:03.068990 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi [None req-4709c670-27bd-4791-a6c9-9421795351b3 admin admin] Calling method '>' {{(pid=104606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:32:03.071888 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: INFO nova.api.openstack.requestlog [None req-4709c670-27bd-4791-a6c9-9421795351b3 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002984 Nov 02 14:32:03.072738 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: [pid: 104606|app: 0|req: 6/13] 10.222.0.30 () {54 vars in 931 bytes} [Wed Nov 2 14:32:03 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:32:03.810548 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi [None req-df8674a2-466f-4bf5-9a58-ba1763d1fb4e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "os-flavor-access:is_public": true, "disk": 10, "swap": 0, "rxtx_factor": 1.0, "name": "ds2G", "ram": 2048}} {{(pid=104605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:32:03.896674 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: INFO nova.api.openstack.requestlog [None req-df8674a2-466f-4bf5-9a58-ba1763d1fb4e admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.816440 Nov 02 14:32:03.897516 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: [pid: 104605|app: 0|req: 8/14] 10.222.0.30 () {64 vars in 1283 bytes} [Wed Nov 2 14:32:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 14:32:03.912350 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi [None req-e7983c05-f3e1-42c1-b521-93096b4335d9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:32:04.009565 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: INFO nova.api.openstack.requestlog [None req-e7983c05-f3e1-42c1-b521-93096b4335d9 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102448 Nov 02 14:32:04.010497 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: [pid: 104606|app: 0|req: 7/15] 10.222.0.30 () {64 vars in 1336 bytes} [Wed Nov 2 14:32:03 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:32:07.148694 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi [None req-df8674a2-466f-4bf5-9a58-ba1763d1fb4e admin admin] Calling method '>' {{(pid=104605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:32:07.149751 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: INFO nova.api.openstack.requestlog [None req-df8674a2-466f-4bf5-9a58-ba1763d1fb4e admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001564 Nov 02 14:32:07.150457 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: [pid: 104605|app: 0|req: 9/16] 10.222.0.30 () {54 vars in 931 bytes} [Wed Nov 2 14:32:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:32:07.752351 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi [None req-80bde350-d421-495c-89fd-510fcf049d60 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "id": "d4", "name": "ds4G", "vcpus": 4, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 20}} {{(pid=104606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:32:07.852212 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: INFO nova.api.openstack.requestlog [None req-80bde350-d421-495c-89fd-510fcf049d60 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.694093 Nov 02 14:32:07.853203 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: [pid: 104606|app: 0|req: 8/17] 10.222.0.30 () {64 vars in 1283 bytes} [Wed Nov 2 14:32:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 14:32:07.874283 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi [None req-a164be66-c929-4187-b2c8-bd7fc4aa2aac admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:32:07.984528 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: INFO nova.api.openstack.requestlog [None req-a164be66-c929-4187-b2c8-bd7fc4aa2aac admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.117131 Nov 02 14:32:07.985615 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: [pid: 104605|app: 0|req: 10/18] 10.222.0.30 () {64 vars in 1336 bytes} [Wed Nov 2 14:32:07 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:32:11.321644 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi [None req-80bde350-d421-495c-89fd-510fcf049d60 admin admin] Calling method '>' {{(pid=104606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:32:11.322841 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: INFO nova.api.openstack.requestlog [None req-80bde350-d421-495c-89fd-510fcf049d60 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001809 Nov 02 14:32:11.323409 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: [pid: 104606|app: 0|req: 9/19] 10.222.0.30 () {54 vars in 931 bytes} [Wed Nov 2 14:32:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:32:12.006486 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi [None req-934f99f7-b7b1-44a2-bb22-881a3d8c0dac admin admin] Calling method '>' {{(pid=104605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:32:12.046858 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: INFO nova.api.openstack.requestlog [None req-934f99f7-b7b1-44a2-bb22-881a3d8c0dac admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.714998 Nov 02 14:32:12.047708 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: [pid: 104605|app: 0|req: 11/20] 10.222.0.30 () {60 vars in 1292 bytes} [Wed Nov 2 14:32:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:32:15.523061 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi [None req-80bde350-d421-495c-89fd-510fcf049d60 admin admin] Calling method '>' {{(pid=104606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:32:15.524813 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: INFO nova.api.openstack.requestlog [None req-80bde350-d421-495c-89fd-510fcf049d60 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002357 Nov 02 14:32:15.525497 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: [pid: 104606|app: 0|req: 10/21] 10.222.0.30 () {54 vars in 931 bytes} [Wed Nov 2 14:32:15 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:32:16.132475 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi [None req-0ee1716e-30a6-44ec-807f-39f1b874a20c admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "name": "m1.tiny", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "rxtx_factor": 1.0, "id": "1", "ram": 512}} {{(pid=104605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:32:16.239176 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: INFO nova.api.openstack.requestlog [None req-0ee1716e-30a6-44ec-807f-39f1b874a20c admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.706134 Nov 02 14:32:16.241333 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: [pid: 104605|app: 0|req: 12/22] 10.222.0.30 () {64 vars in 1283 bytes} [Wed Nov 2 14:32:15 2022] POST /compute/v2.1/flavors => generated 402 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 14:32:16.257321 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi [None req-056716f8-7425-4b8b-b915-4443267915d8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:32:16.362458 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: INFO nova.api.openstack.requestlog [None req-056716f8-7425-4b8b-b915-4443267915d8 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.112461 Nov 02 14:32:16.362458 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: [pid: 104606|app: 0|req: 11/23] 10.222.0.30 () {64 vars in 1333 bytes} [Wed Nov 2 14:32:16 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:32:19.580131 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi [None req-0ee1716e-30a6-44ec-807f-39f1b874a20c admin admin] Calling method '>' {{(pid=104605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:32:19.583449 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: INFO nova.api.openstack.requestlog [None req-0ee1716e-30a6-44ec-807f-39f1b874a20c admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003941 Nov 02 14:32:19.584210 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: [pid: 104605|app: 0|req: 13/24] 10.222.0.30 () {54 vars in 931 bytes} [Wed Nov 2 14:32:19 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:32:20.479779 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi [None req-fa1bf52a-efbe-4b83-8c2f-1d528389928d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "id": "2", "disk": 20, "ram": 2048}} {{(pid=104606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:32:20.491462 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG dbcounter [-] [104606] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=6,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=104606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:32:20.643506 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: INFO nova.api.openstack.requestlog [None req-fa1bf52a-efbe-4b83-8c2f-1d528389928d admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 1.048047 Nov 02 14:32:20.644532 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: [pid: 104606|app: 0|req: 12/25] 10.222.0.30 () {64 vars in 1283 bytes} [Wed Nov 2 14:32:19 2022] POST /compute/v2.1/flavors => generated 405 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 14:32:20.663345 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi [None req-cdce452a-35cd-4e14-9827-3b182795600e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:32:20.789413 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: INFO nova.api.openstack.requestlog [None req-cdce452a-35cd-4e14-9827-3b182795600e admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.135215 Nov 02 14:32:20.790686 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: [pid: 104605|app: 0|req: 14/26] 10.222.0.30 () {64 vars in 1333 bytes} [Wed Nov 2 14:32:20 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:32:24.369029 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi [None req-fa1bf52a-efbe-4b83-8c2f-1d528389928d admin admin] Calling method '>' {{(pid=104606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:32:24.370974 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: INFO nova.api.openstack.requestlog [None req-fa1bf52a-efbe-4b83-8c2f-1d528389928d admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002620 Nov 02 14:32:24.371781 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: [pid: 104606|app: 0|req: 13/27] 10.222.0.30 () {54 vars in 931 bytes} [Wed Nov 2 14:32:24 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:32:25.124463 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi [None req-3584b8fd-8a37-48a8-9c18-ec36c14310a2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "id": "3", "os-flavor-access:is_public": true, "ram": 4096, "swap": 0, "rxtx_factor": 1.0, "disk": 40, "vcpus": 2}} {{(pid=104605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:32:25.134982 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG dbcounter [-] [104605] Writing DB stats nova_api:SELECT=36,nova_api:SAVEPOINT=4,nova_api:INSERT=7,nova_api:RELEASE=4 {{(pid=104605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:32:25.245287 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: INFO nova.api.openstack.requestlog [None req-3584b8fd-8a37-48a8-9c18-ec36c14310a2 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.860925 Nov 02 14:32:25.246099 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: [pid: 104605|app: 0|req: 15/28] 10.222.0.30 () {64 vars in 1283 bytes} [Wed Nov 2 14:32:24 2022] POST /compute/v2.1/flavors => generated 406 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 14:32:25.271764 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi [None req-bd706176-cad0-42ce-9190-f5010f086843 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:32:25.461231 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: INFO nova.api.openstack.requestlog [None req-bd706176-cad0-42ce-9190-f5010f086843 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.203310 Nov 02 14:32:25.462117 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: [pid: 104606|app: 0|req: 14/29] 10.222.0.30 () {64 vars in 1333 bytes} [Wed Nov 2 14:32:25 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:32:28.715981 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi [None req-3584b8fd-8a37-48a8-9c18-ec36c14310a2 admin admin] Calling method '>' {{(pid=104605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:32:28.718109 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: INFO nova.api.openstack.requestlog [None req-3584b8fd-8a37-48a8-9c18-ec36c14310a2 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002608 Nov 02 14:32:28.718817 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: [pid: 104605|app: 0|req: 16/30] 10.222.0.30 () {54 vars in 931 bytes} [Wed Nov 2 14:32:28 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:32:29.673039 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi [None req-f60fa15d-662e-409b-b943-f135a4f54d5f admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "swap": 0, "vcpus": 4, "disk": 80, "name": "m1.large", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4"}} {{(pid=104606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:32:29.791363 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: INFO nova.api.openstack.requestlog [None req-f60fa15d-662e-409b-b943-f135a4f54d5f admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 1.060324 Nov 02 14:32:29.792544 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: [pid: 104606|app: 0|req: 15/31] 10.222.0.30 () {64 vars in 1283 bytes} [Wed Nov 2 14:32:28 2022] POST /compute/v2.1/flavors => generated 405 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 14:32:29.815388 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi [None req-2d58a65b-1c12-4b81-ab61-3140597af85f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:32:29.927294 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: INFO nova.api.openstack.requestlog [None req-2d58a65b-1c12-4b81-ab61-3140597af85f admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.120731 Nov 02 14:32:29.928338 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: [pid: 104605|app: 0|req: 17/32] 10.222.0.30 () {64 vars in 1333 bytes} [Wed Nov 2 14:32:29 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:32:33.758355 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi [None req-f60fa15d-662e-409b-b943-f135a4f54d5f admin admin] Calling method '>' {{(pid=104606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:32:33.760142 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: INFO nova.api.openstack.requestlog [None req-f60fa15d-662e-409b-b943-f135a4f54d5f admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002489 Nov 02 14:32:33.760937 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: [pid: 104606|app: 0|req: 16/33] 10.222.0.30 () {54 vars in 931 bytes} [Wed Nov 2 14:32:33 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:32:34.390536 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi [None req-387ba7a8-7a64-43d1-9bfc-514cb4a43e16 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "id": "5", "disk": 160, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "name": "m1.xlarge", "ram": 16384}} {{(pid=104605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:32:34.496825 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: INFO nova.api.openstack.requestlog [None req-387ba7a8-7a64-43d1-9bfc-514cb4a43e16 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.728353 Nov 02 14:32:34.497821 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: [pid: 104605|app: 0|req: 18/34] 10.222.0.30 () {64 vars in 1283 bytes} [Wed Nov 2 14:32:33 2022] POST /compute/v2.1/flavors => generated 408 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 14:32:34.518117 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi [None req-4498c42b-603c-4871-8307-d09ae919a9d1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:32:34.625955 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: INFO nova.api.openstack.requestlog [None req-4498c42b-603c-4871-8307-d09ae919a9d1 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114889 Nov 02 14:32:34.627429 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: [pid: 104606|app: 0|req: 17/35] 10.222.0.30 () {64 vars in 1333 bytes} [Wed Nov 2 14:32:34 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:32:51.870329 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi [None req-387ba7a8-7a64-43d1-9bfc-514cb4a43e16 admin admin] Calling method '>' {{(pid=104605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:32:51.872094 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: INFO nova.api.openstack.requestlog [None req-387ba7a8-7a64-43d1-9bfc-514cb4a43e16 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002502 Nov 02 14:32:51.872824 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: [pid: 104605|app: 0|req: 19/36] 10.222.0.30 () {54 vars in 931 bytes} [Wed Nov 2 14:32:51 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:32:51.884052 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG dbcounter [-] [104606] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=17,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=104606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:32:52.360288 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi [None req-63ec4224-1e71-42d4-9e91-94db4d60edd3 admin admin] Calling method '>' {{(pid=104606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:32:52.379457 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: INFO nova.api.openstack.requestlog [None req-63ec4224-1e71-42d4-9e91-94db4d60edd3 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.499803 Nov 02 14:32:52.380109 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: [pid: 104606|app: 0|req: 18/37] 10.222.0.30 () {60 vars in 1292 bytes} [Wed Nov 2 14:32:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:32:53.823539 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi [None req-387ba7a8-7a64-43d1-9bfc-514cb4a43e16 admin admin] Calling method '>' {{(pid=104605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:32:53.824543 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: INFO nova.api.openstack.requestlog [None req-387ba7a8-7a64-43d1-9bfc-514cb4a43e16 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Nov 02 14:32:53.824948 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: [pid: 104605|app: 0|req: 20/38] 10.222.0.30 () {56 vars in 1074 bytes} [Wed Nov 2 14:32:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:32:54.440942 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi [None req-56dc5a57-090c-4dfb-929a-25695bdbe318 admin admin] Calling method '>' {{(pid=104606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:32:54.446882 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: INFO nova.api.openstack.wsgi [None req-56dc5a57-090c-4dfb-929a-25695bdbe318 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 02 14:32:54.450370 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi [None req-56dc5a57-090c-4dfb-929a-25695bdbe318 admin admin] Request method failure captured: Nov 02 14:32:54.450370 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Nov 02 14:32:54.450370 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: Accept: application/json Nov 02 14:32:54.450370 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: Accept-Encoding: gzip, deflate Nov 02 14:32:54.450370 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: Connection: keep-alive Nov 02 14:32:54.450370 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: Content-Length: 0 Nov 02 14:32:54.450370 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: Host: 10.222.0.30 Nov 02 14:32:54.450370 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: Openstack-Api-Version: compute 2.92 Nov 02 14:32:54.450370 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: Openstack-System-Scope: None Nov 02 14:32:54.450370 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: User-Agent: python-novaclient Nov 02 14:32:54.450370 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: X-Auth-Token: gAAAAABjYn-V2TmmYyWNJWCVU_kMZKKqtlbaGbhcFYPlpiEBcWzBk1xE2Z3ryV2Xpg7J4YNbm8zuDFCBtdDcvNWL0Lh8U0Z1-XfVYDbR7DYdKua4eHmwNvPVesNWGGjPM9kiSKLMs9TYp4gZbVE1VL05Ay87nxTKAhSB6u3TkY2kuW_rj9XsgaI Nov 02 14:32:54.450370 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: X-Domain-Id: None Nov 02 14:32:54.450370 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: X-Domain-Name: None Nov 02 14:32:54.450370 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: X-Identity-Status: Confirmed Nov 02 14:32:54.450370 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: X-Is-Admin-Project: True Nov 02 14:32:54.450370 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 14:32:54.450370 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: X-Project-Domain-Id: default Nov 02 14:32:54.450370 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: X-Project-Domain-Name: Default Nov 02 14:32:54.450370 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: X-Project-Id: e747be529418447d86ba59ccbdb4ada2 Nov 02 14:32:54.450370 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: X-Project-Name: admin Nov 02 14:32:54.450370 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: X-Role: reader,admin,member Nov 02 14:32:54.450370 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: X-Roles: reader,admin,member Nov 02 14:32:54.453886 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e747be529418447d86ba59ccbdb4ada2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e747be529418447d86ba59ccbdb4ada2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e747be529418447d86ba59ccbdb4ada2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e747be529418447d86ba59ccbdb4ada2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:32:54.453886 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: X-Tenant: admin Nov 02 14:32:54.453886 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: X-Tenant-Id: e747be529418447d86ba59ccbdb4ada2 Nov 02 14:32:54.453886 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: X-Tenant-Name: admin Nov 02 14:32:54.453886 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: X-User: admin Nov 02 14:32:54.453886 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: X-User-Domain-Id: default Nov 02 14:32:54.453886 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: X-User-Domain-Name: Default Nov 02 14:32:54.453886 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: X-User-Id: e928bcf912f045deb4e67843e0dbbcf3 Nov 02 14:32:54.453886 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: X-User-Name: admin Nov 02 14:32:54.453886 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: method: > Nov 02 14:32:54.453886 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: exception: Flavor 42 could not be found. Nov 02 14:32:54.453886 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: action_args: {'id': '42'} Nov 02 14:32:54.453886 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: {{(pid=104606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:32:54.453886 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:32:54.456678 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 14:32:54.456678 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 14:32:54.456678 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 14:32:54.456678 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 14:32:54.456678 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 14:32:54.456678 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 14:32:54.456678 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 14:32:54.456678 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 14:32:54.456678 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 14:32:54.456678 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:32:54.456678 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 14:32:54.456678 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 14:32:54.456678 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Nov 02 14:32:54.456678 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi Nov 02 14:32:54.456678 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:32:54.456678 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi Nov 02 14:32:54.456678 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:32:54.456678 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:32:54.456678 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:32:54.458860 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:32:54.458860 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:32:54.458860 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:32:54.458860 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:32:54.458860 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 14:32:54.458860 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:32:54.458860 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Nov 02 14:32:54.458860 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi Nov 02 14:32:54.458860 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:32:54.458860 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi Nov 02 14:32:54.458860 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:32:54.458860 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:32:54.458860 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:32:54.458860 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:32:54.458860 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:32:54.458860 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Nov 02 14:32:54.458860 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi Nov 02 14:32:54.458860 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi [None req-56dc5a57-090c-4dfb-929a-25695bdbe318 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:32:54.461184 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: INFO nova.api.openstack.requestlog [None req-56dc5a57-090c-4dfb-929a-25695bdbe318 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.470201 Nov 02 14:32:54.461184 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: [pid: 104606|app: 0|req: 19/39] 10.222.0.30 () {60 vars in 1190 bytes} [Wed Nov 2 14:32:53 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 472 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Nov 02 14:32:54.461484 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG dbcounter [-] [104605] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=11,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=104605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:32:54.465339 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi [None req-f6bd0512-7576-4b4a-a6c8-c26bec89b763 admin admin] Calling method '>' {{(pid=104605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:32:54.489877 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: INFO nova.api.openstack.requestlog [None req-f6bd0512-7576-4b4a-a6c8-c26bec89b763 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.029858 Nov 02 14:32:54.490451 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: [pid: 104605|app: 0|req: 21/40] 10.222.0.30 () {60 vars in 1210 bytes} [Wed Nov 2 14:32:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:32:54.502067 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi [None req-15ec5d78-b3ca-41d1-a761-df258bb52e54 admin admin] Calling method '>' {{(pid=104606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:32:54.525886 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: INFO nova.api.openstack.requestlog [None req-15ec5d78-b3ca-41d1-a761-df258bb52e54 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.028871 Nov 02 14:32:54.526475 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: [pid: 104606|app: 0|req: 20/41] 10.222.0.30 () {60 vars in 1210 bytes} [Wed Nov 2 14:32:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:32:54.537419 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi [None req-5672da8f-d843-4b98-bfd7-e1f51d9eae72 admin admin] Calling method '>' {{(pid=104605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:32:54.543570 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: INFO nova.api.openstack.wsgi [None req-5672da8f-d843-4b98-bfd7-e1f51d9eae72 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 02 14:32:54.546996 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi [None req-5672da8f-d843-4b98-bfd7-e1f51d9eae72 admin admin] Request method failure captured: Nov 02 14:32:54.546996 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Nov 02 14:32:54.546996 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: Accept: application/json Nov 02 14:32:54.546996 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: Accept-Encoding: gzip, deflate Nov 02 14:32:54.546996 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: Connection: keep-alive Nov 02 14:32:54.546996 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: Content-Length: 0 Nov 02 14:32:54.546996 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: Host: 10.222.0.30 Nov 02 14:32:54.546996 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: Openstack-Api-Version: compute 2.92 Nov 02 14:32:54.546996 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: Openstack-System-Scope: None Nov 02 14:32:54.546996 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: User-Agent: python-novaclient Nov 02 14:32:54.546996 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: X-Auth-Token: gAAAAABjYn-V2TmmYyWNJWCVU_kMZKKqtlbaGbhcFYPlpiEBcWzBk1xE2Z3ryV2Xpg7J4YNbm8zuDFCBtdDcvNWL0Lh8U0Z1-XfVYDbR7DYdKua4eHmwNvPVesNWGGjPM9kiSKLMs9TYp4gZbVE1VL05Ay87nxTKAhSB6u3TkY2kuW_rj9XsgaI Nov 02 14:32:54.546996 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: X-Domain-Id: None Nov 02 14:32:54.546996 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: X-Domain-Name: None Nov 02 14:32:54.546996 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: X-Identity-Status: Confirmed Nov 02 14:32:54.546996 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: X-Is-Admin-Project: True Nov 02 14:32:54.546996 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 14:32:54.546996 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: X-Project-Domain-Id: default Nov 02 14:32:54.546996 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: X-Project-Domain-Name: Default Nov 02 14:32:54.546996 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: X-Project-Id: e747be529418447d86ba59ccbdb4ada2 Nov 02 14:32:54.546996 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: X-Project-Name: admin Nov 02 14:32:54.546996 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: X-Role: reader,admin,member Nov 02 14:32:54.546996 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: X-Roles: reader,admin,member Nov 02 14:32:54.555174 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e747be529418447d86ba59ccbdb4ada2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e747be529418447d86ba59ccbdb4ada2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e747be529418447d86ba59ccbdb4ada2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e747be529418447d86ba59ccbdb4ada2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:32:54.555174 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: X-Tenant: admin Nov 02 14:32:54.555174 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: X-Tenant-Id: e747be529418447d86ba59ccbdb4ada2 Nov 02 14:32:54.555174 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: X-Tenant-Name: admin Nov 02 14:32:54.555174 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: X-User: admin Nov 02 14:32:54.555174 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: X-User-Domain-Id: default Nov 02 14:32:54.555174 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: X-User-Domain-Name: Default Nov 02 14:32:54.555174 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: X-User-Id: e928bcf912f045deb4e67843e0dbbcf3 Nov 02 14:32:54.555174 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: X-User-Name: admin Nov 02 14:32:54.555174 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: method: > Nov 02 14:32:54.555174 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: exception: Flavor 42 could not be found. Nov 02 14:32:54.555174 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: action_args: {'id': '42'} Nov 02 14:32:54.555174 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: {{(pid=104605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:32:54.555174 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:32:54.556745 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 14:32:54.556745 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 14:32:54.556745 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 14:32:54.556745 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 14:32:54.556745 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 14:32:54.556745 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 14:32:54.556745 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 14:32:54.556745 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 14:32:54.556745 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 14:32:54.556745 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:32:54.556745 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 14:32:54.556745 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 14:32:54.556745 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Nov 02 14:32:54.556745 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi Nov 02 14:32:54.556745 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:32:54.556745 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi Nov 02 14:32:54.556745 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:32:54.556745 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:32:54.556745 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:32:54.558857 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:32:54.558857 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:32:54.558857 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:32:54.558857 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:32:54.558857 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 14:32:54.558857 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:32:54.558857 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Nov 02 14:32:54.558857 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi Nov 02 14:32:54.558857 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:32:54.558857 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi Nov 02 14:32:54.558857 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:32:54.558857 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:32:54.558857 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:32:54.558857 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:32:54.558857 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:32:54.558857 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Nov 02 14:32:54.558857 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi Nov 02 14:32:54.558857 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi [None req-5672da8f-d843-4b98-bfd7-e1f51d9eae72 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:32:54.560917 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: INFO nova.api.openstack.requestlog [None req-5672da8f-d843-4b98-bfd7-e1f51d9eae72 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014793 Nov 02 14:32:54.560917 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: [pid: 104605|app: 0|req: 22/42] 10.222.0.30 () {60 vars in 1190 bytes} [Wed Nov 2 14:32:54 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Nov 02 14:32:55.878177 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi [None req-15ec5d78-b3ca-41d1-a761-df258bb52e54 admin admin] Calling method '>' {{(pid=104606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:32:55.879213 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: INFO nova.api.openstack.requestlog [None req-15ec5d78-b3ca-41d1-a761-df258bb52e54 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 Nov 02 14:32:55.879640 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: [pid: 104606|app: 0|req: 21/43] 10.222.0.30 () {56 vars in 1074 bytes} [Wed Nov 2 14:32:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:32:56.576151 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi [None req-63fbabb6-fc38-41f2-ae7e-822d46c72da7 admin admin] Calling method '>' {{(pid=104605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:32:56.583084 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: INFO nova.api.openstack.wsgi [None req-63fbabb6-fc38-41f2-ae7e-822d46c72da7 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 02 14:32:56.585054 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi [None req-63fbabb6-fc38-41f2-ae7e-822d46c72da7 admin admin] Request method failure captured: Nov 02 14:32:56.585054 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Nov 02 14:32:56.585054 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: Accept: application/json Nov 02 14:32:56.585054 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: Accept-Encoding: gzip, deflate Nov 02 14:32:56.585054 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: Connection: keep-alive Nov 02 14:32:56.585054 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: Content-Length: 0 Nov 02 14:32:56.585054 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: Host: 10.222.0.30 Nov 02 14:32:56.585054 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: Openstack-Api-Version: compute 2.92 Nov 02 14:32:56.585054 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: Openstack-System-Scope: None Nov 02 14:32:56.585054 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: User-Agent: python-novaclient Nov 02 14:32:56.585054 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: X-Auth-Token: gAAAAABjYn-XH451Ur8dd9BmZPi8ZyqcTUml0Jz9zKGmxLqTjPxXWIPl3W9iUBku0h6PMJwCIoxI8fvfUzQya-kb02r2nXlJkkkL3nXyiZT-Wmp3S-nTY7NnbQX0T8RFFmnKiyS-JUqlqQ3DKu6PSHVVVaR_4jPfmlm_ufhToYymFePEj0EupoI Nov 02 14:32:56.585054 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: X-Domain-Id: None Nov 02 14:32:56.585054 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: X-Domain-Name: None Nov 02 14:32:56.585054 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: X-Identity-Status: Confirmed Nov 02 14:32:56.585054 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: X-Is-Admin-Project: True Nov 02 14:32:56.585054 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 14:32:56.585054 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: X-Project-Domain-Id: default Nov 02 14:32:56.585054 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: X-Project-Domain-Name: Default Nov 02 14:32:56.585054 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: X-Project-Id: e747be529418447d86ba59ccbdb4ada2 Nov 02 14:32:56.585054 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: X-Project-Name: admin Nov 02 14:32:56.585054 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: X-Role: reader,admin,member Nov 02 14:32:56.585054 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: X-Roles: reader,admin,member Nov 02 14:32:56.587788 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e747be529418447d86ba59ccbdb4ada2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e747be529418447d86ba59ccbdb4ada2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e747be529418447d86ba59ccbdb4ada2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e747be529418447d86ba59ccbdb4ada2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:32:56.587788 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: X-Tenant: admin Nov 02 14:32:56.587788 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: X-Tenant-Id: e747be529418447d86ba59ccbdb4ada2 Nov 02 14:32:56.587788 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: X-Tenant-Name: admin Nov 02 14:32:56.587788 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: X-User: admin Nov 02 14:32:56.587788 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: X-User-Domain-Id: default Nov 02 14:32:56.587788 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: X-User-Domain-Name: Default Nov 02 14:32:56.587788 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: X-User-Id: e928bcf912f045deb4e67843e0dbbcf3 Nov 02 14:32:56.587788 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: X-User-Name: admin Nov 02 14:32:56.587788 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: method: > Nov 02 14:32:56.587788 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: exception: Flavor 84 could not be found. Nov 02 14:32:56.587788 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: action_args: {'id': '84'} Nov 02 14:32:56.587788 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: {{(pid=104605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:32:56.587788 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:32:56.590209 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 14:32:56.590209 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 14:32:56.590209 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 14:32:56.590209 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 14:32:56.590209 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 14:32:56.590209 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 14:32:56.590209 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 14:32:56.590209 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 14:32:56.590209 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 14:32:56.590209 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:32:56.590209 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 14:32:56.590209 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 14:32:56.590209 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Nov 02 14:32:56.590209 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi Nov 02 14:32:56.590209 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:32:56.590209 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi Nov 02 14:32:56.590209 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:32:56.590209 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:32:56.590209 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:32:56.591441 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:32:56.591441 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:32:56.591441 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:32:56.591441 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:32:56.591441 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 14:32:56.591441 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:32:56.591441 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Nov 02 14:32:56.591441 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi Nov 02 14:32:56.591441 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:32:56.591441 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi Nov 02 14:32:56.591441 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:32:56.591441 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:32:56.591441 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:32:56.591441 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:32:56.591441 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:32:56.591441 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Nov 02 14:32:56.591441 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi Nov 02 14:32:56.591441 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi [None req-63fbabb6-fc38-41f2-ae7e-822d46c72da7 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:32:56.592598 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: INFO nova.api.openstack.requestlog [None req-63fbabb6-fc38-41f2-ae7e-822d46c72da7 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.561429 Nov 02 14:32:56.592598 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: [pid: 104605|app: 0|req: 23/44] 10.222.0.30 () {60 vars in 1190 bytes} [Wed Nov 2 14:32:56 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 563 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Nov 02 14:32:56.599493 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi [None req-ced476ca-ad76-4779-874b-330cd7730410 admin admin] Calling method '>' {{(pid=104606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:32:56.616584 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: INFO nova.api.openstack.requestlog [None req-ced476ca-ad76-4779-874b-330cd7730410 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020739 Nov 02 14:32:56.617195 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: [pid: 104606|app: 0|req: 22/45] 10.222.0.30 () {60 vars in 1210 bytes} [Wed Nov 2 14:32:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:32:56.627739 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi [None req-6a40a37a-034b-411c-93cc-bd63f326003b admin admin] Calling method '>' {{(pid=104605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:32:56.644838 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: INFO nova.api.openstack.requestlog [None req-6a40a37a-034b-411c-93cc-bd63f326003b admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.021210 Nov 02 14:32:56.645465 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: [pid: 104605|app: 0|req: 24/46] 10.222.0.30 () {60 vars in 1210 bytes} [Wed Nov 2 14:32:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:32:56.655480 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi [None req-008fd64f-3ce2-49d1-94a5-17571d60b3f1 admin admin] Calling method '>' {{(pid=104606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:32:56.663380 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: INFO nova.api.openstack.wsgi [None req-008fd64f-3ce2-49d1-94a5-17571d60b3f1 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 02 14:32:56.664944 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi [None req-008fd64f-3ce2-49d1-94a5-17571d60b3f1 admin admin] Request method failure captured: Nov 02 14:32:56.664944 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Nov 02 14:32:56.664944 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: Accept: application/json Nov 02 14:32:56.664944 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: Accept-Encoding: gzip, deflate Nov 02 14:32:56.664944 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: Connection: keep-alive Nov 02 14:32:56.664944 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: Content-Length: 0 Nov 02 14:32:56.664944 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: Host: 10.222.0.30 Nov 02 14:32:56.664944 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: Openstack-Api-Version: compute 2.92 Nov 02 14:32:56.664944 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: Openstack-System-Scope: None Nov 02 14:32:56.664944 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: User-Agent: python-novaclient Nov 02 14:32:56.664944 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: X-Auth-Token: gAAAAABjYn-XH451Ur8dd9BmZPi8ZyqcTUml0Jz9zKGmxLqTjPxXWIPl3W9iUBku0h6PMJwCIoxI8fvfUzQya-kb02r2nXlJkkkL3nXyiZT-Wmp3S-nTY7NnbQX0T8RFFmnKiyS-JUqlqQ3DKu6PSHVVVaR_4jPfmlm_ufhToYymFePEj0EupoI Nov 02 14:32:56.664944 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: X-Domain-Id: None Nov 02 14:32:56.664944 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: X-Domain-Name: None Nov 02 14:32:56.664944 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: X-Identity-Status: Confirmed Nov 02 14:32:56.664944 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: X-Is-Admin-Project: True Nov 02 14:32:56.664944 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 14:32:56.664944 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: X-Project-Domain-Id: default Nov 02 14:32:56.664944 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: X-Project-Domain-Name: Default Nov 02 14:32:56.664944 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: X-Project-Id: e747be529418447d86ba59ccbdb4ada2 Nov 02 14:32:56.664944 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: X-Project-Name: admin Nov 02 14:32:56.664944 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: X-Role: reader,admin,member Nov 02 14:32:56.664944 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: X-Roles: reader,admin,member Nov 02 14:32:56.667367 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e747be529418447d86ba59ccbdb4ada2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e747be529418447d86ba59ccbdb4ada2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e747be529418447d86ba59ccbdb4ada2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e747be529418447d86ba59ccbdb4ada2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:32:56.667367 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: X-Tenant: admin Nov 02 14:32:56.667367 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: X-Tenant-Id: e747be529418447d86ba59ccbdb4ada2 Nov 02 14:32:56.667367 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: X-Tenant-Name: admin Nov 02 14:32:56.667367 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: X-User: admin Nov 02 14:32:56.667367 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: X-User-Domain-Id: default Nov 02 14:32:56.667367 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: X-User-Domain-Name: Default Nov 02 14:32:56.667367 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: X-User-Id: e928bcf912f045deb4e67843e0dbbcf3 Nov 02 14:32:56.667367 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: X-User-Name: admin Nov 02 14:32:56.667367 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: method: > Nov 02 14:32:56.667367 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: exception: Flavor 84 could not be found. Nov 02 14:32:56.667367 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: action_args: {'id': '84'} Nov 02 14:32:56.667367 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: {{(pid=104606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:32:56.667367 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:32:56.668930 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 14:32:56.668930 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 14:32:56.668930 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 14:32:56.668930 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 14:32:56.668930 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 14:32:56.668930 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 14:32:56.668930 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 14:32:56.668930 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 14:32:56.668930 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 14:32:56.668930 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:32:56.668930 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 14:32:56.668930 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 14:32:56.668930 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Nov 02 14:32:56.668930 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi Nov 02 14:32:56.668930 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:32:56.668930 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi Nov 02 14:32:56.668930 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:32:56.668930 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:32:56.668930 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:32:56.671198 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:32:56.671198 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:32:56.671198 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:32:56.671198 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:32:56.671198 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 14:32:56.671198 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:32:56.671198 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Nov 02 14:32:56.671198 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi Nov 02 14:32:56.671198 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:32:56.671198 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi Nov 02 14:32:56.671198 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:32:56.671198 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:32:56.671198 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:32:56.671198 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:32:56.671198 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:32:56.671198 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Nov 02 14:32:56.671198 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi Nov 02 14:32:56.671198 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi [None req-008fd64f-3ce2-49d1-94a5-17571d60b3f1 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:32:56.673509 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: INFO nova.api.openstack.requestlog [None req-008fd64f-3ce2-49d1-94a5-17571d60b3f1 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.014541 Nov 02 14:32:56.673509 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: [pid: 104606|app: 0|req: 23/47] 10.222.0.30 () {60 vars in 1190 bytes} [Wed Nov 2 14:32:56 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 14:32:58.280128 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi [None req-6a40a37a-034b-411c-93cc-bd63f326003b admin admin] Calling method '>' {{(pid=104605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:32:58.281882 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: INFO nova.api.openstack.requestlog [None req-6a40a37a-034b-411c-93cc-bd63f326003b admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002004 Nov 02 14:32:58.282793 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: [pid: 104605|app: 0|req: 25/48] 10.222.0.30 () {56 vars in 1074 bytes} [Wed Nov 2 14:32:58 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:32:58.856493 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi [None req-a2346627-cae7-4cf3-ab2a-d994efecde7a admin admin] Calling method '>' {{(pid=104606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:32:58.863292 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: INFO nova.api.openstack.wsgi [None req-a2346627-cae7-4cf3-ab2a-d994efecde7a admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 02 14:32:58.865137 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi [None req-a2346627-cae7-4cf3-ab2a-d994efecde7a admin admin] Request method failure captured: Nov 02 14:32:58.865137 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Nov 02 14:32:58.865137 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: Accept: application/json Nov 02 14:32:58.865137 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: Accept-Encoding: gzip, deflate Nov 02 14:32:58.865137 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: Connection: keep-alive Nov 02 14:32:58.865137 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: Content-Length: 0 Nov 02 14:32:58.865137 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: Host: 10.222.0.30 Nov 02 14:32:58.865137 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: Openstack-Api-Version: compute 2.92 Nov 02 14:32:58.865137 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: Openstack-System-Scope: None Nov 02 14:32:58.865137 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: User-Agent: python-novaclient Nov 02 14:32:58.865137 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: X-Auth-Token: gAAAAABjYn-aX9xRVGaMOQlZXFUhYJYWUPfVlRHbA4ivMJUYz6YjDuVedExYhLVDi6B98zzCwKnVTLdDkklEO4Okl5PFo7ATc322IOV8ZW997-9O4OBLacPxPx5PMUn5MKQqLzIzyDZ9eylHk04r5vrgKCi7yV6M2GgeFLkSWi1cG_g4MpIXk0U Nov 02 14:32:58.865137 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: X-Domain-Id: None Nov 02 14:32:58.865137 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: X-Domain-Name: None Nov 02 14:32:58.865137 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: X-Identity-Status: Confirmed Nov 02 14:32:58.865137 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: X-Is-Admin-Project: True Nov 02 14:32:58.865137 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 14:32:58.865137 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: X-Project-Domain-Id: default Nov 02 14:32:58.865137 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: X-Project-Domain-Name: Default Nov 02 14:32:58.865137 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: X-Project-Id: e747be529418447d86ba59ccbdb4ada2 Nov 02 14:32:58.865137 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: X-Project-Name: admin Nov 02 14:32:58.865137 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: X-Role: reader,admin,member Nov 02 14:32:58.865137 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: X-Roles: reader,admin,member Nov 02 14:32:58.867959 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e747be529418447d86ba59ccbdb4ada2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e747be529418447d86ba59ccbdb4ada2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e747be529418447d86ba59ccbdb4ada2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e747be529418447d86ba59ccbdb4ada2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:32:58.867959 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: X-Tenant: admin Nov 02 14:32:58.867959 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: X-Tenant-Id: e747be529418447d86ba59ccbdb4ada2 Nov 02 14:32:58.867959 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: X-Tenant-Name: admin Nov 02 14:32:58.867959 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: X-User: admin Nov 02 14:32:58.867959 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: X-User-Domain-Id: default Nov 02 14:32:58.867959 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: X-User-Domain-Name: Default Nov 02 14:32:58.867959 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: X-User-Id: e928bcf912f045deb4e67843e0dbbcf3 Nov 02 14:32:58.867959 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: X-User-Name: admin Nov 02 14:32:58.867959 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: method: > Nov 02 14:32:58.867959 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: exception: Flavor 451 could not be found. Nov 02 14:32:58.867959 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: action_args: {'id': '451'} Nov 02 14:32:58.867959 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: {{(pid=104606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:32:58.867959 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:32:58.869600 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 14:32:58.869600 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 14:32:58.869600 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 14:32:58.869600 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 14:32:58.869600 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 14:32:58.869600 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 14:32:58.869600 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 14:32:58.869600 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 14:32:58.869600 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 14:32:58.869600 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:32:58.869600 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 14:32:58.869600 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 14:32:58.869600 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Nov 02 14:32:58.869600 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi Nov 02 14:32:58.869600 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:32:58.869600 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi Nov 02 14:32:58.869600 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:32:58.869600 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:32:58.869600 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:32:58.871585 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:32:58.871585 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:32:58.871585 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:32:58.871585 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:32:58.871585 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 14:32:58.871585 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:32:58.871585 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Nov 02 14:32:58.871585 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi Nov 02 14:32:58.871585 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:32:58.871585 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi Nov 02 14:32:58.871585 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:32:58.871585 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:32:58.871585 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:32:58.871585 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:32:58.871585 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:32:58.871585 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Nov 02 14:32:58.871585 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: ERROR nova.api.openstack.wsgi Nov 02 14:32:58.871585 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi [None req-a2346627-cae7-4cf3-ab2a-d994efecde7a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:32:58.873798 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: INFO nova.api.openstack.requestlog [None req-a2346627-cae7-4cf3-ab2a-d994efecde7a admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.441504 Nov 02 14:32:58.873798 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: [pid: 104606|app: 0|req: 24/49] 10.222.0.30 () {60 vars in 1193 bytes} [Wed Nov 2 14:32:58 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 443 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 14:32:58.878983 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi [None req-6e1187eb-af40-4d4d-8749-190d0ca2ffac admin admin] Calling method '>' {{(pid=104605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:32:58.895108 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: INFO nova.api.openstack.requestlog [None req-6e1187eb-af40-4d4d-8749-190d0ca2ffac admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020149 Nov 02 14:32:58.895668 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: [pid: 104605|app: 0|req: 26/50] 10.222.0.30 () {60 vars in 1210 bytes} [Wed Nov 2 14:32:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:32:58.908334 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi [None req-78ffb657-995d-47d6-9985-f036901e04fb admin admin] Calling method '>' {{(pid=104606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:32:58.925467 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: INFO nova.api.openstack.requestlog [None req-78ffb657-995d-47d6-9985-f036901e04fb admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.022882 Nov 02 14:32:58.925947 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: [pid: 104606|app: 0|req: 25/51] 10.222.0.30 () {60 vars in 1210 bytes} [Wed Nov 2 14:32:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:32:58.935527 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi [None req-35990b65-7e27-470f-97bb-efe996140895 admin admin] Calling method '>' {{(pid=104605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:32:58.941201 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: INFO nova.api.openstack.wsgi [None req-35990b65-7e27-470f-97bb-efe996140895 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 02 14:32:58.942713 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi [None req-35990b65-7e27-470f-97bb-efe996140895 admin admin] Request method failure captured: Nov 02 14:32:58.942713 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Nov 02 14:32:58.942713 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: Accept: application/json Nov 02 14:32:58.942713 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: Accept-Encoding: gzip, deflate Nov 02 14:32:58.942713 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: Connection: keep-alive Nov 02 14:32:58.942713 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: Content-Length: 0 Nov 02 14:32:58.942713 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: Host: 10.222.0.30 Nov 02 14:32:58.942713 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: Openstack-Api-Version: compute 2.92 Nov 02 14:32:58.942713 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: Openstack-System-Scope: None Nov 02 14:32:58.942713 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: User-Agent: python-novaclient Nov 02 14:32:58.942713 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: X-Auth-Token: gAAAAABjYn-aX9xRVGaMOQlZXFUhYJYWUPfVlRHbA4ivMJUYz6YjDuVedExYhLVDi6B98zzCwKnVTLdDkklEO4Okl5PFo7ATc322IOV8ZW997-9O4OBLacPxPx5PMUn5MKQqLzIzyDZ9eylHk04r5vrgKCi7yV6M2GgeFLkSWi1cG_g4MpIXk0U Nov 02 14:32:58.942713 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: X-Domain-Id: None Nov 02 14:32:58.942713 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: X-Domain-Name: None Nov 02 14:32:58.942713 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: X-Identity-Status: Confirmed Nov 02 14:32:58.942713 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: X-Is-Admin-Project: True Nov 02 14:32:58.942713 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 14:32:58.942713 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: X-Project-Domain-Id: default Nov 02 14:32:58.942713 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: X-Project-Domain-Name: Default Nov 02 14:32:58.942713 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: X-Project-Id: e747be529418447d86ba59ccbdb4ada2 Nov 02 14:32:58.942713 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: X-Project-Name: admin Nov 02 14:32:58.942713 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: X-Role: reader,admin,member Nov 02 14:32:58.942713 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: X-Roles: reader,admin,member Nov 02 14:32:58.944222 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e747be529418447d86ba59ccbdb4ada2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e747be529418447d86ba59ccbdb4ada2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e747be529418447d86ba59ccbdb4ada2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e747be529418447d86ba59ccbdb4ada2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:32:58.944222 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: X-Tenant: admin Nov 02 14:32:58.944222 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: X-Tenant-Id: e747be529418447d86ba59ccbdb4ada2 Nov 02 14:32:58.944222 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: X-Tenant-Name: admin Nov 02 14:32:58.944222 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: X-User: admin Nov 02 14:32:58.944222 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: X-User-Domain-Id: default Nov 02 14:32:58.944222 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: X-User-Domain-Name: Default Nov 02 14:32:58.944222 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: X-User-Id: e928bcf912f045deb4e67843e0dbbcf3 Nov 02 14:32:58.944222 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: X-User-Name: admin Nov 02 14:32:58.944222 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: method: > Nov 02 14:32:58.944222 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: exception: Flavor 451 could not be found. Nov 02 14:32:58.944222 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: action_args: {'id': '451'} Nov 02 14:32:58.944222 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: {{(pid=104605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:32:58.944222 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:32:58.945174 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 14:32:58.945174 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 14:32:58.945174 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 14:32:58.945174 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 14:32:58.945174 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 14:32:58.945174 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 14:32:58.945174 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 14:32:58.945174 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 14:32:58.945174 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 14:32:58.945174 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:32:58.945174 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 14:32:58.945174 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 14:32:58.945174 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Nov 02 14:32:58.945174 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi Nov 02 14:32:58.945174 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:32:58.945174 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi Nov 02 14:32:58.945174 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:32:58.945174 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:32:58.945174 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:32:58.946614 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:32:58.946614 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:32:58.946614 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:32:58.946614 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:32:58.946614 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 14:32:58.946614 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:32:58.946614 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Nov 02 14:32:58.946614 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi Nov 02 14:32:58.946614 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:32:58.946614 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi Nov 02 14:32:58.946614 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:32:58.946614 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:32:58.946614 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:32:58.946614 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:32:58.946614 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:32:58.946614 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Nov 02 14:32:58.946614 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: ERROR nova.api.openstack.wsgi Nov 02 14:32:58.946614 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi [None req-35990b65-7e27-470f-97bb-efe996140895 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:32:58.948203 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: INFO nova.api.openstack.requestlog [None req-35990b65-7e27-470f-97bb-efe996140895 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012172 Nov 02 14:32:58.948203 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: [pid: 104605|app: 0|req: 27/52] 10.222.0.30 () {60 vars in 1193 bytes} [Wed Nov 2 14:32:58 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 14:33:00.195788 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi [None req-78ffb657-995d-47d6-9985-f036901e04fb admin admin] Calling method '>' {{(pid=104606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:33:00.197023 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: INFO nova.api.openstack.requestlog [None req-78ffb657-995d-47d6-9985-f036901e04fb admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001715 Nov 02 14:33:00.197488 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: [pid: 104606|app: 0|req: 26/53] 10.222.0.30 () {56 vars in 1074 bytes} [Wed Nov 2 14:33:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:33:00.832977 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi [None req-6b3605a2-a8f5-41ec-b5d0-a2e8dfeb74bd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:33:00.910105 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: INFO nova.api.openstack.requestlog [None req-6b3605a2-a8f5-41ec-b5d0-a2e8dfeb74bd admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.571832 Nov 02 14:33:00.910706 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: [pid: 104605|app: 0|req: 28/54] 10.222.0.30 () {64 vars in 1235 bytes} [Wed Nov 2 14:33:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 14:33:02.186229 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi [None req-78ffb657-995d-47d6-9985-f036901e04fb admin admin] Calling method '>' {{(pid=104606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:33:02.187252 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: INFO nova.api.openstack.requestlog [None req-78ffb657-995d-47d6-9985-f036901e04fb admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Nov 02 14:33:02.188822 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: [pid: 104606|app: 0|req: 27/55] 10.222.0.30 () {56 vars in 1074 bytes} [Wed Nov 2 14:33:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:33:02.867353 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi [None req-1c0d0cbd-0b5c-4af5-a531-46b5c1776b11 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:33:02.944353 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: INFO nova.api.openstack.requestlog [None req-1c0d0cbd-0b5c-4af5-a531-46b5c1776b11 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.616664 Nov 02 14:33:02.944924 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: [pid: 104605|app: 0|req: 29/56] 10.222.0.30 () {64 vars in 1235 bytes} [Wed Nov 2 14:33:02 2022] POST /compute/v2.1/flavors => generated 405 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 14:33:04.276028 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi [None req-78ffb657-995d-47d6-9985-f036901e04fb admin admin] Calling method '>' {{(pid=104606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:33:04.279767 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: INFO nova.api.openstack.requestlog [None req-78ffb657-995d-47d6-9985-f036901e04fb admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Nov 02 14:33:04.279767 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: [pid: 104606|app: 0|req: 28/57] 10.222.0.30 () {56 vars in 1074 bytes} [Wed Nov 2 14:33:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:33:04.884256 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi [None req-06f5780a-d28b-4b6d-86fe-62434c6d39a9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:33:04.975067 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: INFO nova.api.openstack.requestlog [None req-06f5780a-d28b-4b6d-86fe-62434c6d39a9 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.552279 Nov 02 14:33:04.976143 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: [pid: 104605|app: 0|req: 30/58] 10.222.0.30 () {64 vars in 1235 bytes} [Wed Nov 2 14:33:04 2022] POST /compute/v2.1/flavors => generated 407 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 14:33:06.247460 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi [None req-78ffb657-995d-47d6-9985-f036901e04fb admin admin] Calling method '>' {{(pid=104606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:33:06.248546 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: INFO nova.api.openstack.requestlog [None req-78ffb657-995d-47d6-9985-f036901e04fb admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Nov 02 14:33:06.248992 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: [pid: 104606|app: 0|req: 29/59] 10.222.0.30 () {56 vars in 1074 bytes} [Wed Nov 2 14:33:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:33:06.832451 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi [None req-07283031-1192-4ff6-bdd3-fa89fa83947d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:33:06.915583 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: INFO nova.api.openstack.requestlog [None req-07283031-1192-4ff6-bdd3-fa89fa83947d admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.523677 Nov 02 14:33:06.916410 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: [pid: 104605|app: 0|req: 31/60] 10.222.0.30 () {64 vars in 1235 bytes} [Wed Nov 2 14:33:06 2022] POST /compute/v2.1/flavors => generated 409 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 14:33:08.494392 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi [None req-78ffb657-995d-47d6-9985-f036901e04fb admin admin] Calling method '>' {{(pid=104606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:33:08.495394 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: INFO nova.api.openstack.requestlog [None req-78ffb657-995d-47d6-9985-f036901e04fb admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Nov 02 14:33:08.495891 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: [pid: 104606|app: 0|req: 30/61] 10.222.0.30 () {56 vars in 1074 bytes} [Wed Nov 2 14:33:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:33:09.047627 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi [None req-226dc7e3-7e9a-4798-ad2d-461a5e6b72c5 admin admin] Calling method '>' {{(pid=104605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:33:09.068383 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: INFO nova.api.openstack.requestlog [None req-226dc7e3-7e9a-4798-ad2d-461a5e6b72c5 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.430475 Nov 02 14:33:09.068938 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: [pid: 104605|app: 0|req: 32/62] 10.222.0.30 () {60 vars in 1202 bytes} [Wed Nov 2 14:33:08 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:34:13.928326 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi [None req-78ffb657-995d-47d6-9985-f036901e04fb admin admin] Calling method '>' {{(pid=104606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:34:13.929385 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: INFO nova.api.openstack.requestlog [None req-78ffb657-995d-47d6-9985-f036901e04fb admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Nov 02 14:34:13.929791 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: [pid: 104606|app: 0|req: 31/63] 10.222.0.30 () {54 vars in 931 bytes} [Wed Nov 2 14:34:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:34:13.940467 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG dbcounter [-] [104605] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=104605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:34:14.414555 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi [None req-476741d4-bed1-4455-a0d9-8511cfdcc7b7 admin admin] Calling method '>' {{(pid=104605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:34:14.439631 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: INFO nova.api.openstack.requestlog [None req-476741d4-bed1-4455-a0d9-8511cfdcc7b7 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.501002 Nov 02 14:34:14.440273 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: [pid: 104605|app: 0|req: 33/64] 10.222.0.30 () {60 vars in 1292 bytes} [Wed Nov 2 14:34:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:34:14.482563 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG dbcounter [-] [104606] Writing DB stats nova_api:SELECT=14 {{(pid=104606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:34:14.482563 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi [None req-0c327e4f-30a8-405a-8b00-f84c5e6a02cd admin admin] Calling method '>' {{(pid=104606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:34:14.488913 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: INFO nova.api.openstack.requestlog [None req-0c327e4f-30a8-405a-8b00-f84c5e6a02cd admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014765 Nov 02 14:34:14.489737 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: [pid: 104606|app: 0|req: 32/65] 10.222.0.30 () {60 vars in 1283 bytes} [Wed Nov 2 14:34:14 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:34:14.502927 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi [None req-54bea69e-fff2-4aed-bba2-bb80efde8b00 admin admin] Calling method '>' {{(pid=104605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:34:14.511533 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: INFO nova.api.openstack.requestlog [None req-54bea69e-fff2-4aed-bba2-bb80efde8b00 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012323 Nov 02 14:34:14.512929 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: [pid: 104605|app: 0|req: 34/66] 10.222.0.30 () {60 vars in 1286 bytes} [Wed Nov 2 14:34:14 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:34:14.525364 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi [None req-6f2f9559-8ef1-4871-af92-d09b6c0a7101 admin admin] Calling method '>' {{(pid=104606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:34:14.534618 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: INFO nova.api.openstack.requestlog [None req-6f2f9559-8ef1-4871-af92-d09b6c0a7101 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013039 Nov 02 14:34:14.535211 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: [pid: 104606|app: 0|req: 33/67] 10.222.0.30 () {60 vars in 1286 bytes} [Wed Nov 2 14:34:14 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:34:14.549579 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi [None req-3350e213-5ba1-4906-bdb5-eb5a5f14228d admin admin] Calling method '>' {{(pid=104605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:34:14.557406 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: INFO nova.api.openstack.requestlog [None req-3350e213-5ba1-4906-bdb5-eb5a5f14228d admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011971 Nov 02 14:34:14.557968 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: [pid: 104605|app: 0|req: 35/68] 10.222.0.30 () {60 vars in 1283 bytes} [Wed Nov 2 14:34:14 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:37:22.749746 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi [None req-6f2f9559-8ef1-4871-af92-d09b6c0a7101 admin admin] Calling method '>' {{(pid=104606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:22.750787 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: INFO nova.api.openstack.requestlog [None req-6f2f9559-8ef1-4871-af92-d09b6c0a7101 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Nov 02 14:37:22.751185 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: [pid: 104606|app: 0|req: 34/69] 10.222.0.30 () {56 vars in 1074 bytes} [Wed Nov 2 14:37:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:37:22.894072 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG dbcounter [-] [104605] Writing DB stats nova_api:SELECT=6 {{(pid=104605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:37:23.040474 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi [None req-50833074-cbd6-4f20-a49c-ae95ca53b196 admin admin] Calling method '>' {{(pid=104605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:23.045326 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG oslo_concurrency.lockutils [None req-50833074-cbd6-4f20-a49c-ae95ca53b196 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:23.045735 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG oslo_concurrency.lockutils [None req-50833074-cbd6-4f20-a49c-ae95ca53b196 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:23.046177 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG oslo_concurrency.lockutils [None req-50833074-cbd6-4f20-a49c-ae95ca53b196 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:23.046861 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG oslo_concurrency.lockutils [None req-50833074-cbd6-4f20-a49c-ae95ca53b196 admin admin] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:23.047299 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG oslo_concurrency.lockutils [None req-50833074-cbd6-4f20-a49c-ae95ca53b196 admin admin] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:23.047708 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG oslo_concurrency.lockutils [None req-50833074-cbd6-4f20-a49c-ae95ca53b196 admin admin] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:23.077971 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: INFO nova.api.openstack.requestlog [None req-50833074-cbd6-4f20-a49c-ae95ca53b196 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.185203 Nov 02 14:37:23.078527 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: [pid: 104605|app: 0|req: 36/70] 10.222.0.30 () {60 vars in 1193 bytes} [Wed Nov 2 14:37:22 2022] GET /compute/v2.1/os-services => generated 791 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 14:37:24.149479 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi [None req-6f2f9559-8ef1-4871-af92-d09b6c0a7101 admin admin] Calling method '>' {{(pid=104606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:24.150484 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: INFO nova.api.openstack.requestlog [None req-6f2f9559-8ef1-4871-af92-d09b6c0a7101 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Nov 02 14:37:24.150875 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: [pid: 104606|app: 0|req: 35/71] 10.222.0.30 () {56 vars in 1074 bytes} [Wed Nov 2 14:37:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:37:24.342102 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi [None req-5fec2e0c-2260-4e37-bc7b-cfe47bbeeb80 admin admin] Calling method '>' {{(pid=104605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:24.345644 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG oslo_concurrency.lockutils [None req-5fec2e0c-2260-4e37-bc7b-cfe47bbeeb80 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:24.346112 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG oslo_concurrency.lockutils [None req-5fec2e0c-2260-4e37-bc7b-cfe47bbeeb80 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:24.346532 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG oslo_concurrency.lockutils [None req-5fec2e0c-2260-4e37-bc7b-cfe47bbeeb80 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:24.347439 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG oslo_concurrency.lockutils [None req-5fec2e0c-2260-4e37-bc7b-cfe47bbeeb80 admin admin] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:24.347881 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG oslo_concurrency.lockutils [None req-5fec2e0c-2260-4e37-bc7b-cfe47bbeeb80 admin admin] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:24.348294 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG oslo_concurrency.lockutils [None req-5fec2e0c-2260-4e37-bc7b-cfe47bbeeb80 admin admin] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:24.371959 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: INFO nova.api.openstack.requestlog [None req-5fec2e0c-2260-4e37-bc7b-cfe47bbeeb80 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.081653 Nov 02 14:37:24.372451 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: [pid: 104605|app: 0|req: 37/72] 10.222.0.30 () {60 vars in 1193 bytes} [Wed Nov 2 14:37:24 2022] GET /compute/v2.1/os-services => generated 791 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 14:37:35.863562 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi [None req-6f2f9559-8ef1-4871-af92-d09b6c0a7101 admin admin] Calling method '>' {{(pid=104606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:35.864616 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: INFO nova.api.openstack.requestlog [None req-6f2f9559-8ef1-4871-af92-d09b6c0a7101 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Nov 02 14:37:35.865034 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: [pid: 104606|app: 0|req: 36/73] 10.222.0.30 () {56 vars in 1074 bytes} [Wed Nov 2 14:37:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:37:36.014975 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG dbcounter [-] [104605] Writing DB stats nova_cell0:SELECT=4 {{(pid=104605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:37:36.015697 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG dbcounter [-] [104605] Writing DB stats nova_cell1:SELECT=4 {{(pid=104605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:37:36.016326 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG dbcounter [-] [104605] Writing DB stats nova_api:SELECT=8 {{(pid=104605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:37:36.064964 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi [None req-d11be1f0-3828-4381-8df2-29da266a1cb8 admin admin] Calling method '>' {{(pid=104605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:36.068460 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG oslo_concurrency.lockutils [None req-d11be1f0-3828-4381-8df2-29da266a1cb8 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:36.068874 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG oslo_concurrency.lockutils [None req-d11be1f0-3828-4381-8df2-29da266a1cb8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:36.069327 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG oslo_concurrency.lockutils [None req-d11be1f0-3828-4381-8df2-29da266a1cb8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:36.070066 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG oslo_concurrency.lockutils [None req-d11be1f0-3828-4381-8df2-29da266a1cb8 admin admin] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:36.070505 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG oslo_concurrency.lockutils [None req-d11be1f0-3828-4381-8df2-29da266a1cb8 admin admin] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:36.070916 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG oslo_concurrency.lockutils [None req-d11be1f0-3828-4381-8df2-29da266a1cb8 admin admin] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:36.096548 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: INFO nova.api.openstack.requestlog [None req-d11be1f0-3828-4381-8df2-29da266a1cb8 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.086040 Nov 02 14:37:36.097124 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: [pid: 104605|app: 0|req: 38/74] 10.222.0.30 () {60 vars in 1193 bytes} [Wed Nov 2 14:37:36 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:37:37.196233 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG nova.api.openstack.wsgi [None req-6f2f9559-8ef1-4871-af92-d09b6c0a7101 admin admin] Calling method '>' {{(pid=104606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:37.197267 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: INFO nova.api.openstack.requestlog [None req-6f2f9559-8ef1-4871-af92-d09b6c0a7101 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Nov 02 14:37:37.197664 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: [pid: 104606|app: 0|req: 37/75] 10.222.0.30 () {56 vars in 1074 bytes} [Wed Nov 2 14:37:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:37:37.391538 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG nova.api.openstack.wsgi [None req-426a822b-269d-4f71-aba1-fec3d609703c admin admin] Calling method '>' {{(pid=104605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:37.395147 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG oslo_concurrency.lockutils [None req-426a822b-269d-4f71-aba1-fec3d609703c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:37.395631 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG oslo_concurrency.lockutils [None req-426a822b-269d-4f71-aba1-fec3d609703c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:37.396056 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG oslo_concurrency.lockutils [None req-426a822b-269d-4f71-aba1-fec3d609703c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:37.397285 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG oslo_concurrency.lockutils [None req-426a822b-269d-4f71-aba1-fec3d609703c admin admin] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:37.397736 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG oslo_concurrency.lockutils [None req-426a822b-269d-4f71-aba1-fec3d609703c admin admin] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:37.398344 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: DEBUG oslo_concurrency.lockutils [None req-426a822b-269d-4f71-aba1-fec3d609703c admin admin] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:37.420537 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: INFO nova.api.openstack.requestlog [None req-426a822b-269d-4f71-aba1-fec3d609703c admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.081545 Nov 02 14:37:37.421042 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: [pid: 104605|app: 0|req: 39/76] 10.222.0.30 () {60 vars in 1193 bytes} [Wed Nov 2 14:37:37 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:38:32.739596 dv-cinder-862365-4-iscsi devstack@n-api.service[104604]: Wed Nov 2 14:38:32 2022 - graceful shutdown triggered... Nov 02 14:38:32.763614 dv-cinder-862365-4-iscsi devstack@n-api.service[104605]: Gracefully killing worker 1 (pid: 104605)... Nov 02 14:38:32.743471 dv-cinder-862365-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Nov 02 14:38:32.764757 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: Gracefully killing worker 2 (pid: 104606)... Nov 02 14:38:32.868173 dv-cinder-862365-4-iscsi devstack@n-api.service[104606]: DEBUG dbcounter [-] [104606] Writing DB stats nova_api:SELECT=4 {{(pid=104606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:38:33.740808 dv-cinder-862365-4-iscsi devstack@n-api.service[104604]: worker 1 buried after 1 seconds Nov 02 14:38:33.740808 dv-cinder-862365-4-iscsi devstack@n-api.service[104604]: worker 2 buried after 1 seconds Nov 02 14:38:33.740808 dv-cinder-862365-4-iscsi devstack@n-api.service[104604]: goodbye to uWSGI. Nov 02 14:38:33.742354 dv-cinder-862365-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Nov 02 14:38:33.742917 dv-cinder-862365-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Nov 02 14:38:33.745733 dv-cinder-862365-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 02 14:38:33.762569 dv-cinder-862365-4-iscsi devstack@n-api.service[119644]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 02 14:38:33.764842 dv-cinder-862365-4-iscsi devstack@n-api.service[119644]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Nov 2 14:38:33 2022] *** Nov 02 14:38:33.764842 dv-cinder-862365-4-iscsi devstack@n-api.service[119644]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 02 14:38:33.764842 dv-cinder-862365-4-iscsi devstack@n-api.service[119644]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 02 14:38:33.764842 dv-cinder-862365-4-iscsi devstack@n-api.service[119644]: nodename: dv-cinder-862365-4-iscsi Nov 02 14:38:33.764842 dv-cinder-862365-4-iscsi devstack@n-api.service[119644]: machine: x86_64 Nov 02 14:38:33.764842 dv-cinder-862365-4-iscsi devstack@n-api.service[119644]: clock source: unix Nov 02 14:38:33.764842 dv-cinder-862365-4-iscsi devstack@n-api.service[119644]: pcre jit disabled Nov 02 14:38:33.764842 dv-cinder-862365-4-iscsi devstack@n-api.service[119644]: detected number of CPU cores: 4 Nov 02 14:38:33.764842 dv-cinder-862365-4-iscsi devstack@n-api.service[119644]: current working directory: / Nov 02 14:38:33.764842 dv-cinder-862365-4-iscsi devstack@n-api.service[119644]: detected binary path: /usr/bin/uwsgi-core Nov 02 14:38:33.765692 dv-cinder-862365-4-iscsi devstack@n-api.service[119644]: your processes number limit is 47680 Nov 02 14:38:33.765692 dv-cinder-862365-4-iscsi devstack@n-api.service[119644]: your memory page size is 4096 bytes Nov 02 14:38:33.765692 dv-cinder-862365-4-iscsi devstack@n-api.service[119644]: detected max file descriptor number: 2048 Nov 02 14:38:33.765692 dv-cinder-862365-4-iscsi devstack@n-api.service[119644]: lock engine: pthread robust mutexes Nov 02 14:38:33.765692 dv-cinder-862365-4-iscsi devstack@n-api.service[119644]: thunder lock: enabled Nov 02 14:38:33.765692 dv-cinder-862365-4-iscsi devstack@n-api.service[119644]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 02 14:38:33.765692 dv-cinder-862365-4-iscsi devstack@n-api.service[119644]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Nov 02 14:38:33.805173 dv-cinder-862365-4-iscsi devstack@n-api.service[119644]: Python main interpreter initialized at 0x557601b9c9c0 Nov 02 14:38:33.805173 dv-cinder-862365-4-iscsi devstack@n-api.service[119644]: python threads support enabled Nov 02 14:38:33.805173 dv-cinder-862365-4-iscsi devstack@n-api.service[119644]: your server socket listen backlog is limited to 100 connections Nov 02 14:38:33.805173 dv-cinder-862365-4-iscsi devstack@n-api.service[119644]: your mercy for graceful operations on workers is 90 seconds Nov 02 14:38:33.805981 dv-cinder-862365-4-iscsi devstack@n-api.service[119644]: mapped 403077 bytes (393 KB) for 2 cores Nov 02 14:38:33.805981 dv-cinder-862365-4-iscsi devstack@n-api.service[119644]: *** Operational MODE: preforking *** Nov 02 14:38:33.805981 dv-cinder-862365-4-iscsi devstack@n-api.service[119644]: *** uWSGI is running in multiple interpreter mode *** Nov 02 14:38:33.805981 dv-cinder-862365-4-iscsi devstack@n-api.service[119644]: spawned uWSGI master process (pid: 119644) Nov 02 14:38:33.806116 dv-cinder-862365-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 02 14:38:33.811032 dv-cinder-862365-4-iscsi devstack@n-api.service[119644]: spawned uWSGI worker 1 (pid: 119658, cores: 1) Nov 02 14:38:33.811032 dv-cinder-862365-4-iscsi devstack@n-api.service[119644]: spawned uWSGI worker 2 (pid: 119659, cores: 1) Nov 02 14:38:33.811032 dv-cinder-862365-4-iscsi devstack@n-api.service[119644]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 02 14:38:34.509716 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Nov 02 14:38:34.584240 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Nov 02 14:38:35.803785 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 14:38:35.803785 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: from cryptography.utils import int_from_bytes Nov 02 14:38:35.804334 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 14:38:35.804334 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: from cryptography.utils import int_from_bytes Nov 02 14:38:35.838433 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 14:38:35.838433 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: from cryptography.utils import int_from_bytes Nov 02 14:38:35.839076 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 14:38:35.839076 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: from cryptography.utils import int_from_bytes Nov 02 14:38:38.304916 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 14:38:38.305501 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 14:38:38.305761 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 14:38:38.306148 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 14:38:38.306410 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 14:38:38.306803 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.307145 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.307475 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.307798 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.308133 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.308449 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.308776 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.309132 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.309467 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.309734 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.310056 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.310155 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 14:38:38.310551 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-862365-4-iscsi {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.310651 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 14:38:38.310747 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.310909 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 14:38:38.311002 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.311277 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 14:38:38.311381 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.311535 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 14:38:38.311633 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.311899 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.312002 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.312226 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.312341 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.312538 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.312673 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.312862 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.313084 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.313286 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.313598 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.313829 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.313927 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.314144 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.314255 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.314464 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.314569 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.314790 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.314892 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.315108 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.315215 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.315426 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.316061 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-862365-4-iscsi {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.316258 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.316352 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.316583 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.316685 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.316920 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.317040 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.317265 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.317368 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.317648 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.317752 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-862365-4-iscsi {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.317973 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.318131 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.318279 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.318458 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.318775 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.318892 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.319086 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.319187 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.319402 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.319499 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.319717 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.319838 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.320059 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.320169 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.320378 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.320480 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.320694 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.320795 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.321036 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.321138 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.321351 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.321525 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.321692 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.321864 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.322014 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.322156 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.322305 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.322455 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-862365-4-iscsi {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.322606 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.322754 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.322919 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.323080 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.323247 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.323437 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.323588 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.323736 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.323895 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.324044 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.324240 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.324388 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.324534 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.324675 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.324830 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.324980 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.325168 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.325312 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.325463 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.325615 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.325771 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.325922 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.326072 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.326224 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.326372 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.326527 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.326676 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.326819 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.326959 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.327115 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.327257 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.327413 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.327554 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.327694 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.327833 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.327980 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.328202 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.328345 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.328496 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.328644 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.328846 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.329109 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.329295 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.329440 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.329587 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.329734 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.329875 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.330024 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.330179 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.330331 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.330331 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.330666 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.330818 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.330973 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.331225 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.331378 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.331529 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.331677 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.331819 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.331972 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.332113 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.332261 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.332404 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.332551 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.332700 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.332849 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.333024 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.333191 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.333340 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.333480 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.333630 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.333779 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.333926 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.334073 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.334215 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.334396 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.334552 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.334695 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.334846 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.334846 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.335129 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.335275 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.335428 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.335577 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.335724 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.335870 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.336021 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.336162 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.336317 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.336465 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.336612 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.336758 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.336917 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.337118 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.337289 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.337438 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.337588 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.337728 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.337876 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.338025 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.338175 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.338325 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.338473 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.338614 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.338760 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.338925 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.339074 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.339215 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.339362 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.339509 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.339651 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.339799 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.339948 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.340096 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.340237 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.340382 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.340534 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.340820 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.340973 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.341147 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.341288 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.341429 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.341579 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.341729 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.341870 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.342010 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.342149 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.342296 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.342448 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.342590 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.342740 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.342896 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.343045 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.343193 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.343347 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.343494 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.343634 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.343789 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.343939 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.344087 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.344233 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.344384 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.344532 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.344696 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.344839 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.344980 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.345164 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.345314 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.345464 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.345618 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.345800 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.345951 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.346100 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.346255 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.346396 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.346536 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.347221 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.347373 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.347523 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.347670 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.347881 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.347881 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.348172 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.348325 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.348474 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.348623 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.348772 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.348922 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.349097 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.349269 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.349419 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.349569 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.349710 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.349849 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.349989 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.350138 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.350279 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.350419 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.350566 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.350713 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.350868 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.351042 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.351186 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.351326 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.351466 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.351612 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.351933 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.351933 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.352204 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.352357 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.352499 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.352647 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.352894 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.353085 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.353254 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.353649 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.353796 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.354010 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.354170 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.354314 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.354463 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.354612 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.354759 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.354901 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.355049 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.355202 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.355351 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.355503 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.355651 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.355806 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.355806 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 14:38:38.356079 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.356227 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.356369 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.356510 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.356730 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.356874 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.357039 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.357187 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.357338 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.357479 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.357632 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.357780 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.357928 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.358141 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.358303 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.358455 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.358606 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.358760 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.358909 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.359051 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.359198 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.359360 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.359516 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.359667 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.359808 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.359948 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.360097 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.360239 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.360388 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.360539 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.360686 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.360844 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.360994 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.361256 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.361423 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.361567 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.361715 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.361864 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.362018 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.362160 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.362353 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.362584 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.362769 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.362913 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.363098 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.363243 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.363412 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.363562 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.363711 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.363860 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.364001 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.364150 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.364303 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.364444 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.364584 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.364740 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.364882 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.365070 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.365228 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.365387 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.365536 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.365678 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.365828 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.365979 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.366128 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.366269 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.366415 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.366563 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.366711 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.366862 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.367009 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.367151 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.367300 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.367441 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.367589 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.367731 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.367872 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.368013 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.368184 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.368335 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.368486 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.368628 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.368845 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.369033 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.369195 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.369355 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.369509 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.369659 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.369814 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.369957 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.370104 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.370254 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.370409 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.370562 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.370717 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.370862 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.371003 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.371163 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.371334 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.371483 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.371647 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.371795 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.371964 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.372124 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.372274 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.372426 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.372575 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.372718 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.372858 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.373035 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.373195 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.373336 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.373477 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.373617 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.373787 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.373952 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.374121 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.374270 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.374513 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.374673 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.374815 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.374968 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.375117 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.375277 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.375426 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.375574 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.375724 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.375872 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.376020 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.376166 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.376308 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.376449 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.376604 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.376753 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.376894 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.377069 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.377228 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.377370 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.377562 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.377719 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.377869 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.378612 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.378790 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.379047 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.379354 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.379509 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.379652 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.379801 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.379960 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.380111 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.380262 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.380404 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.380587 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.380744 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.380886 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.381112 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.381262 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.381403 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.381552 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.381705 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.381846 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.382011 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.382161 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.382311 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.382460 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.382610 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.382765 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.382907 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.383047 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.383194 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.383342 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.383491 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.383716 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.383861 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.384012 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.384168 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.384310 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.384450 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.384600 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.384750 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.384891 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.385064 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.385212 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.385353 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.385590 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.386047 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.386212 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.386366 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.386508 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.386667 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.386820 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.386970 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.387112 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.387259 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.387407 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.387559 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.387700 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.387849 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.387990 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.388152 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.388307 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.388457 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.388598 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.388739 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.388887 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.389109 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.389259 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.389413 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.389555 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.389702 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.389958 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.390111 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.390111 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.390414 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.390414 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.390683 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.390823 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.390973 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.391137 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.391281 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.391428 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.391579 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.392521 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.392679 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.392834 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.392976 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.392976 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.393282 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.393429 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.393642 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.394556 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.394784 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.395026 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.395251 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.396262 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.396478 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.396478 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.396774 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.396916 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.397087 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.397245 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.397388 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.397536 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.397686 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.397835 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.397985 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.398139 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.398291 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.398432 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.398579 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.398737 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.398886 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.399041 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.399182 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.399323 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.399464 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.399603 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.399805 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.399961 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.400111 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.400258 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.400400 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.400541 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.400691 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.400840 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.400989 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.401190 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.401343 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.401493 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.401644 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.401792 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.401933 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.402080 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.402222 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.402369 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.402530 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.402672 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.402820 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.402989 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.403133 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.403253 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.403372 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.403484 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.403601 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.403717 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.403837 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.403955 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.404079 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.404188 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.404304 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.404419 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.404530 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.404650 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.404767 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.404884 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.404992 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.405125 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.410677 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.410830 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.410936 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.411026 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.411113 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.411198 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.411283 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.411381 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.411475 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.411568 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.411652 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.411742 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.411827 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.411924 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.412010 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.412093 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.412175 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.412257 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.412353 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.412445 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.412529 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.412621 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.412705 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.412787 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.412883 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.412985 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.413102 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.413217 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.413338 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.413414 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.413506 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.413506 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.413674 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.413765 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.413849 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.413947 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.414045 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.414045 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.414205 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.414296 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.414381 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.414476 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.414568 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.414568 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.414719 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.414809 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.414893 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.415046 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.415137 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.415221 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.415304 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.415431 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.415530 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.415628 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.415713 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.415804 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.415895 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.415986 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.416071 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.416236 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.416322 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.416405 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.416495 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.416596 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.416677 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.416780 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.416878 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.416970 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.417074 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.417146 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.417242 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.417335 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.417419 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.417510 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.417612 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.417693 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.417776 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.417848 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.417938 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.418022 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.418104 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.418104 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.418267 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.418351 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.418435 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.418516 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.418607 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.418699 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.418784 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.418872 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.418963 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.419071 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.419157 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.419240 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.419323 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.419412 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.419891 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.420025 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.420122 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.420233 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.420334 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.420419 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.420505 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.420654 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.420971 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.421092 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.421312 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.421418 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.421623 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.421726 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.421941 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.422036 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.422251 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.422375 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.422561 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.422703 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.422871 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.423039 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.423183 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.423376 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.423518 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.423698 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.423791 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.424013 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.424117 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.424330 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.424444 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.424749 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.424990 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.425467 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.425626 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.425626 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.425916 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.426080 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.426238 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.426394 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.426543 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.426725 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.426888 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.427080 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.427252 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.427439 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.427598 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.427749 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.427749 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.428054 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.428210 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.428359 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.428515 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.428672 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.428834 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.428983 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.429166 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.429334 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.429491 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.429646 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.429804 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.429952 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.430106 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.430261 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.430410 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.430567 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.430716 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.430871 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.431034 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.431183 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.431341 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.431502 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.431658 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.431807 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.431954 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.432112 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.432268 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.432425 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.432581 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.432730 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.432886 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.433108 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.433293 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.433444 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.433628 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.433784 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.433934 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.434082 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.434239 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.434395 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.434543 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.434691 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.434846 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.435010 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.435210 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.435373 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.435530 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.435679 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.435827 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.435974 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.436169 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.436319 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.436473 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.436621 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.436782 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.436937 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.437160 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.437311 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.437470 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.437626 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.437775 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.437931 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.438086 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.438235 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.438390 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.438539 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.438686 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.438843 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.438992 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.439140 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.439287 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.439451 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.439606 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.439764 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.439914 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.440068 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.440225 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.440374 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.441150 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.441318 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.441426 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.441524 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.441621 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.441756 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.441914 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.442016 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.442114 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.442213 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.442300 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.442383 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.442475 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.442560 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.442649 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.442734 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.442817 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.443138 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.443371 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.443468 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.443561 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.443664 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.443736 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.443837 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.444012 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.444104 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.444380 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.444690 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.445039 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.445232 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.445395 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.445569 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.445719 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.445875 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.446036 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.446192 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.446342 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.446575 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.446727 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.446885 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.447047 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.447228 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.447453 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.447619 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.447778 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.447927 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.448087 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.448242 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.448428 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.448582 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.448829 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.449033 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.449209 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.449367 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.449522 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.449680 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.449829 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.450302 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.450481 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.450646 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.451309 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.451541 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.451911 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.452004 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.452090 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.452174 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.452265 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.452358 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.452491 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.452585 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.452680 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.452766 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.452856 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.452856 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.453085 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.453186 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.453272 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.453451 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.453588 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.453769 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.453903 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.454086 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.454250 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.454490 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.454640 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.454811 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.454933 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.455131 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.455226 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.455457 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.455599 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.455779 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.455879 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.456134 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.456917 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.457045 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.460315 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.460419 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.460497 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.460569 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.460648 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.460735 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.460810 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.460888 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.461030 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.461115 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.461211 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.461386 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.461477 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.461569 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.461663 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.461748 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.461841 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.461936 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.461936 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.462100 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.462191 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.462277 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.462277 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.462444 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.462531 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.462622 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.462703 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.462786 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.462882 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.462974 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.463054 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.463136 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.463228 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.463313 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.463406 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.463491 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.463574 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.463666 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.463751 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.463855 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.463947 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.464172 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.464300 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.464481 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.464579 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.464793 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.464899 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.465135 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.465233 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.465443 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.465588 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.465827 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.465952 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.466125 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.466220 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.466431 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.466525 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.466743 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.466849 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.467050 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.467194 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.467402 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.467509 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.467702 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.467808 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.468014 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.468342 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.468434 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.468703 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.468815 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.469038 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.469147 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.469360 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.469453 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.469678 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.469802 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.469995 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.470122 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.470321 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.470430 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.470734 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.470852 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.471041 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.471165 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.471373 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.471476 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.471766 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.471886 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.472091 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.472281 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.472404 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.472633 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.472766 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.472956 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.473562 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.473657 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.473756 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.473857 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.473961 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.474047 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.474131 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.474226 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.474328 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.474548 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.474663 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.474859 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.474967 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.475165 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.475310 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.475487 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.475592 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.475908 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.476020 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.476221 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.476316 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.476527 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.476620 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.476862 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.476954 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.477270 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.477378 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.477589 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.477704 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.477898 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.478001 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.478217 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.478564 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.478783 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.478877 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.479095 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.479197 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.479419 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.479513 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.479731 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.479831 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.480052 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.480164 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.480439 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.480553 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.480689 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.480801 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.481029 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.481151 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.481332 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.481434 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.481662 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.481755 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.481973 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.482145 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.482300 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.482400 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.482618 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.482715 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.483351 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.483482 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.483574 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.483661 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.483745 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.483843 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.484072 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.484184 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.484394 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.484497 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.484701 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.484806 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.485031 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.490135 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.490243 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.490332 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.490417 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.490517 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.490622 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.490719 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.490807 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.490904 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.491004 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.491116 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.491212 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.491298 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.491298 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.491462 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.491462 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.491625 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.491716 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.491801 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.491801 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.491953 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.492035 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.492132 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.492218 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.492310 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.492396 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.492486 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.492580 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.492674 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.492760 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.492843 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.492934 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.493161 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.493274 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.493363 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.493454 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.493454 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.493614 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.493699 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.493806 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.493974 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.494066 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.494158 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.494252 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.494344 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.494438 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.494524 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.494609 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.494693 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.494806 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.494901 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.495041 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.495132 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.495205 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.495296 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.495381 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.495472 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.495566 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.495651 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.495734 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.495826 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.495912 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.496004 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.496129 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.496256 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.496348 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.496481 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.496576 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.496576 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.496747 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.496839 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.496931 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.497046 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.497188 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.497288 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.497381 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.497466 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.497549 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.497640 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.497737 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.497831 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.497918 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.498043 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.498238 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.498340 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.498559 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.498661 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.498885 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.498979 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.499213 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.499313 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.499517 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.499617 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.499839 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.500099 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.500238 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.500472 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.500580 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.500798 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.500979 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.501129 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.501220 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.501469 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.501579 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.501775 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.501879 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.502107 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.502203 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.502420 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.502515 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.502744 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.502845 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.503646 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.503833 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.503977 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.504161 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.504294 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.504482 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.504623 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.504803 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.504954 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.505215 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.505339 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.505538 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.505764 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.505899 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.506079 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.506215 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.506397 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.506536 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.506719 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.506855 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.507096 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.507199 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.507423 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.507726 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.507828 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.508044 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.508135 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.508362 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.508453 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.508678 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.508778 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.508992 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.509138 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.509330 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.509423 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.509648 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.509759 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.509959 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.510060 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.510276 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.510412 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.510590 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.510691 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.510902 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.511005 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.511219 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.511348 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.511544 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.511714 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.511867 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.511959 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.512202 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.512292 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.512522 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.512608 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.512836 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.512927 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.513219 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.513328 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.513550 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.513864 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.513961 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.514188 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.514282 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.514491 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.514590 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.514805 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.514897 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.515120 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.515212 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.515434 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.515524 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.515770 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.515863 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.516085 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.516185 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.516399 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.516499 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.516713 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.516818 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.517281 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.517408 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.517408 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.517808 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.518027 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.518344 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.518568 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.519321 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.519469 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.519569 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.519763 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.519901 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.520080 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.520426 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.520527 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.520755 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.520856 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.521113 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.521234 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.521435 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.521529 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.521759 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.521877 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.522078 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.522293 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.522394 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.522614 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.522715 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.522950 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.523050 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.523327 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.523426 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.523645 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.523740 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.523967 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.524072 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.524281 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.524373 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.524588 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.524681 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.524905 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.525031 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.530189 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.530292 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.530366 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.530515 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.530611 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.530706 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.530794 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.530886 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.530979 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.531124 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.531220 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.531315 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.531402 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.531486 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.531579 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.531654 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.531747 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.531828 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.531915 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.532006 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.532101 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.532188 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.532281 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.532281 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.532457 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.532549 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.532633 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.532717 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.532813 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.532906 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.533113 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.533220 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.533318 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.533411 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.533510 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.533597 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.533690 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.533782 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.533868 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.533868 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.534038 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.534124 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.534238 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.534333 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.534419 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.534517 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.534611 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.534704 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.534789 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.534928 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.535022 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.535123 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.535212 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.535306 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.535459 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.535558 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.535659 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.535805 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.535935 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.536052 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.536171 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.536292 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.536292 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.536292 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.536535 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.536677 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.536773 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.536867 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.536965 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.537149 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.537288 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.537391 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.537478 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.537562 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.537562 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.537733 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.537733 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.537901 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.537994 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.538080 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.538080 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.538256 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.538256 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.538419 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.538585 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.538694 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.538889 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.538989 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.539207 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.539359 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.539509 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.539614 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.539816 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.539918 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.540131 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.540237 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.540438 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.540588 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.540753 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.540852 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.541086 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.541184 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.541402 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.541512 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.541749 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.541869 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.542112 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.542232 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.542382 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.542618 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.542713 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.543021 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.543136 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.543347 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.543560 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.543662 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.543755 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.543913 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.544008 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.544219 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.544372 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.544524 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.544662 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.544828 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.544922 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.545178 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.545287 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.545495 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.545589 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.545811 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.545912 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.546125 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.546220 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.546438 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.546532 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.546748 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.546850 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.547058 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.547200 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.547370 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.547649 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.547836 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.547939 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.548164 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.548259 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.548474 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.548567 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.548792 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.548894 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.549132 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.549245 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.549446 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.549548 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.549759 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.550483 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.550680 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.550821 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.550976 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.551240 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.551350 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.551633 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.552789 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.552942 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.553090 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.553183 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.557528 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.557631 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.557771 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.557876 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.557970 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.558055 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.558153 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.558240 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.558325 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.558409 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.558493 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.558646 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.558751 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.558844 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.558931 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.559015 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.559106 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.559199 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.559335 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.559425 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.559518 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.559604 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.559689 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.559787 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.559881 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.559967 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.560100 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.560189 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.560282 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.560282 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.560458 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.560551 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.560644 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.560644 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.560890 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.560978 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.561144 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.561243 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.561325 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.561325 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.561487 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.561579 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.561664 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.561748 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.561832 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.561915 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.562015 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.562108 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.562193 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.562277 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.562359 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.562500 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.562599 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.562695 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.562781 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.562781 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.562944 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.563079 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.563182 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.563264 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.563344 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.563429 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.563525 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.563626 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.563832 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.563935 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.564022 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.564107 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.564202 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.564301 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.564388 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.564472 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.564607 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.564697 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.564871 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.564969 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.565115 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.565218 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.565305 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.565389 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.565636 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.565784 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.565915 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.566007 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.566007 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.566172 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.566270 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.566364 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.566449 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.566620 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.566714 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.566945 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.567060 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.567228 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.567321 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.567529 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.567623 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.567863 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.567958 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.568198 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.568297 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.568709 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.568815 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.568911 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.569097 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.569243 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.569336 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.569563 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.569665 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.569872 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.569965 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.570187 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.570288 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.570507 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.570624 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.570816 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.570909 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.571127 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.571227 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.571443 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.571544 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.571754 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.571855 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.572068 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.572174 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.572393 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.572544 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.572726 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.572879 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.573054 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.573184 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.573371 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.573547 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.573699 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.573847 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.574030 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.574141 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.574335 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.574450 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.574697 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.574848 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.575012 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.575133 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.575395 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.575502 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.575718 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.575849 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.576035 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.576129 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.576364 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.576469 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.576615 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 14:38:38.576708 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.576976 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.577309 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.577623 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.577936 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.578254 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.578568 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.578880 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.579198 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.579520 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.579894 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.580227 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.580538 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.580863 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.581732 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.587467 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.587467 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.587467 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.587467 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.587467 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.587467 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.587467 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 14:38:38.587467 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 14:38:38.641922 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO dbcounter [None req-c2277540-29fc-4b2d-bc9e-f8cb6cc21053 None None] Registered counter for database nova_api Nov 02 14:38:38.648338 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO dbcounter [None req-a6f91f41-7fc1-4ab7-98a9-329a0a604e12 None None] Registered counter for database nova_api Nov 02 14:38:38.663868 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_db.sqlalchemy.engines [None req-c2277540-29fc-4b2d-bc9e-f8cb6cc21053 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119659) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 14:38:38.671094 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_db.sqlalchemy.engines [None req-a6f91f41-7fc1-4ab7-98a9-329a0a604e12 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119658) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 14:38:38.671354 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writer thread running {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 14:38:38.678747 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writer thread running {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 14:38:38.730157 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.context [None req-c2277540-29fc-4b2d-bc9e-f8cb6cc21053 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8d61f910-ccfe-4a5e-a533-9675eb6757f8(cell1) {{(pid=119659) load_cells /opt/stack/nova/nova/context.py:464}} Nov 02 14:38:38.734350 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c2277540-29fc-4b2d-bc9e-f8cb6cc21053 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:38.734916 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c2277540-29fc-4b2d-bc9e-f8cb6cc21053 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:38.736510 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c2277540-29fc-4b2d-bc9e-f8cb6cc21053 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:38.737639 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c2277540-29fc-4b2d-bc9e-f8cb6cc21053 None None] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:38.737867 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c2277540-29fc-4b2d-bc9e-f8cb6cc21053 None None] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:38.738674 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.context [None req-a6f91f41-7fc1-4ab7-98a9-329a0a604e12 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8d61f910-ccfe-4a5e-a533-9675eb6757f8(cell1) {{(pid=119658) load_cells /opt/stack/nova/nova/context.py:464}} Nov 02 14:38:38.739830 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c2277540-29fc-4b2d-bc9e-f8cb6cc21053 None None] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:38.742091 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO dbcounter [None req-c2277540-29fc-4b2d-bc9e-f8cb6cc21053 None None] Registered counter for database nova_cell0 Nov 02 14:38:38.742803 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a6f91f41-7fc1-4ab7-98a9-329a0a604e12 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:38.743275 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a6f91f41-7fc1-4ab7-98a9-329a0a604e12 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:38.745011 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a6f91f41-7fc1-4ab7-98a9-329a0a604e12 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:38.745726 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a6f91f41-7fc1-4ab7-98a9-329a0a604e12 None None] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:38.746167 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a6f91f41-7fc1-4ab7-98a9-329a0a604e12 None None] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:38.746349 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO dbcounter [None req-c2277540-29fc-4b2d-bc9e-f8cb6cc21053 None None] Registered counter for database nova_cell1 Nov 02 14:38:38.748159 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a6f91f41-7fc1-4ab7-98a9-329a0a604e12 None None] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:38.750291 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO dbcounter [None req-a6f91f41-7fc1-4ab7-98a9-329a0a604e12 None None] Registered counter for database nova_cell0 Nov 02 14:38:38.755187 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO dbcounter [None req-a6f91f41-7fc1-4ab7-98a9-329a0a604e12 None None] Registered counter for database nova_cell1 Nov 02 14:38:38.756119 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_db.sqlalchemy.engines [None req-c2277540-29fc-4b2d-bc9e-f8cb6cc21053 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119659) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 14:38:38.758141 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_db.sqlalchemy.engines [None req-c2277540-29fc-4b2d-bc9e-f8cb6cc21053 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119659) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 14:38:38.762711 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_db.sqlalchemy.engines [None req-a6f91f41-7fc1-4ab7-98a9-329a0a604e12 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119658) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 14:38:38.764982 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_db.sqlalchemy.engines [None req-a6f91f41-7fc1-4ab7-98a9-329a0a604e12 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119658) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 14:38:38.765843 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writer thread running {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 14:38:38.768053 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writer thread running {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 14:38:38.771416 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writer thread running {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 14:38:38.923845 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writer thread running {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 14:38:38.926199 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO dbcounter [None req-c2277540-29fc-4b2d-bc9e-f8cb6cc21053 None None] Registered counter for database nova_cell0 Nov 02 14:38:38.932922 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_db.sqlalchemy.engines [None req-c2277540-29fc-4b2d-bc9e-f8cb6cc21053 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119659) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 14:38:38.935018 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO dbcounter [None req-a6f91f41-7fc1-4ab7-98a9-329a0a604e12 None None] Registered counter for database nova_cell0 Nov 02 14:38:38.938230 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writer thread running {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 14:38:38.945171 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_db.sqlalchemy.engines [None req-a6f91f41-7fc1-4ab7-98a9-329a0a604e12 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119658) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 14:38:38.951028 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writer thread running {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 14:38:39.275411 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: WARNING keystonemiddleware.auth_token [None req-c2277540-29fc-4b2d-bc9e-f8cb6cc21053 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 14:38:39.276972 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: WARNING keystonemiddleware.auth_token [None req-a6f91f41-7fc1-4ab7-98a9-329a0a604e12 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 14:38:39.283088 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: WARNING keystonemiddleware.auth_token [None req-c2277540-29fc-4b2d-bc9e-f8cb6cc21053 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 14:38:39.284377 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: WARNING keystonemiddleware.auth_token [None req-a6f91f41-7fc1-4ab7-98a9-329a0a604e12 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 14:38:39.635887 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: WARNING keystonemiddleware.auth_token [None req-a6f91f41-7fc1-4ab7-98a9-329a0a604e12 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 14:38:39.642147 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: WARNING keystonemiddleware.auth_token [None req-a6f91f41-7fc1-4ab7-98a9-329a0a604e12 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 14:38:39.643743 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: WARNING keystonemiddleware.auth_token [None req-c2277540-29fc-4b2d-bc9e-f8cb6cc21053 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 14:38:39.647713 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557601b9c9c0 pid: 119658 (default app) Nov 02 14:38:39.651683 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: WARNING keystonemiddleware.auth_token [None req-c2277540-29fc-4b2d-bc9e-f8cb6cc21053 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 14:38:39.655549 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557601b9c9c0 pid: 119659 (default app) Nov 02 14:39:17.285827 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_api:SELECT=3 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:39:17.286934 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell0:SELECT=3 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:39:17.287925 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell1:SELECT=3 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:39:17.289165 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell0:SELECT=3 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:39:18.537276 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-cefb4c14-31ba-4140-aee7-45f845924699 tempest-VolumesGetTestJSON-1513942985 tempest-VolumesGetTestJSON-1513942985-project] Action: 'create', calling method: .version_select at 0x7fb24fef1f70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1971015602", "metadata": {"Type": "work"}}} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:39:19.198191 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_api:SELECT=3 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:39:19.199358 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell0:SELECT=3 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:39:19.200602 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell1:SELECT=3 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:39:19.201808 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell0:SELECT=3 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:39:19.603996 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-4bef1c33-7aa0-44e8-a7fc-ca39e07cc8a1 tempest-VolumesTestJSON-399215457 tempest-VolumesTestJSON-399215457-project] Calling method '.version_select at 0x7fb24fe61ca0>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:20.761740 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-4bef1c33-7aa0-44e8-a7fc-ca39e07cc8a1 tempest-VolumesTestJSON-399215457 tempest-VolumesTestJSON-399215457-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/c59db040-d130-4fb2-9c41-04f8cc52364e" status: 200 len: 350 microversion: 2.1 time: 1.568445 Nov 02 14:39:20.772007 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 1/1] 10.222.0.30 () {58 vars in 1245 bytes} [Wed Nov 2 14:39:19 2022] GET /compute/v2.1/os-volumes/c59db040-d130-4fb2-9c41-04f8cc52364e => generated 350 bytes in 1581 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:39:20.832664 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-cefb4c14-31ba-4140-aee7-45f845924699 tempest-VolumesGetTestJSON-1513942985 tempest-VolumesGetTestJSON-1513942985-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.552702 Nov 02 14:39:20.835836 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 1/2] 10.222.0.30 () {60 vars in 1156 bytes} [Wed Nov 2 14:39:17 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3558 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 02 14:39:20.851478 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-e5cfd4c8-e7f2-4e30-bfc4-bd68e095861a tempest-VolumesGetTestJSON-1513942985 tempest-VolumesGetTestJSON-1513942985-project] Calling method '.version_select at 0x7fb24fd3bdc0>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:21.153170 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-e5cfd4c8-e7f2-4e30-bfc4-bd68e095861a tempest-VolumesGetTestJSON-1513942985 tempest-VolumesGetTestJSON-1513942985-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/c465ae2e-a9dd-4924-8d82-a973529a4fac" status: 200 len: 353 microversion: 2.1 time: 0.305660 Nov 02 14:39:21.153742 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 2/3] 10.222.0.30 () {58 vars in 1245 bytes} [Wed Nov 2 14:39:20 2022] GET /compute/v2.1/os-volumes/c465ae2e-a9dd-4924-8d82-a973529a4fac => generated 353 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:39:22.170134 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-bdf59e4d-278e-4eae-887a-195f878191e7 tempest-VolumesGetTestJSON-1513942985 tempest-VolumesGetTestJSON-1513942985-project] Calling method '.version_select at 0x7fb24fd00dc0>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:22.304166 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-bdf59e4d-278e-4eae-887a-195f878191e7 tempest-VolumesGetTestJSON-1513942985 tempest-VolumesGetTestJSON-1513942985-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/c465ae2e-a9dd-4924-8d82-a973529a4fac" status: 200 len: 354 microversion: 2.1 time: 0.139128 Nov 02 14:39:22.304731 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 2/4] 10.222.0.30 () {58 vars in 1245 bytes} [Wed Nov 2 14:39:22 2022] GET /compute/v2.1/os-volumes/c465ae2e-a9dd-4924-8d82-a973529a4fac => generated 354 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:39:22.332442 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-4f5b592a-82f8-4101-93c9-0ed7144a48fb tempest-VolumesGetTestJSON-1513942985 tempest-VolumesGetTestJSON-1513942985-project] Calling method '.version_select at 0x7fb24fcf5550>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:22.584172 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-4f5b592a-82f8-4101-93c9-0ed7144a48fb tempest-VolumesGetTestJSON-1513942985 tempest-VolumesGetTestJSON-1513942985-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/c465ae2e-a9dd-4924-8d82-a973529a4fac" status: 200 len: 354 microversion: 2.1 time: 0.269042 Nov 02 14:39:22.597084 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 3/5] 10.222.0.30 () {58 vars in 1245 bytes} [Wed Nov 2 14:39:22 2022] GET /compute/v2.1/os-volumes/c465ae2e-a9dd-4924-8d82-a973529a4fac => generated 354 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:39:22.607022 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-452efd0f-9a2e-4669-936d-2e6f08ee4138 tempest-VolumesGetTestJSON-1513942985 tempest-VolumesGetTestJSON-1513942985-project] Calling method '.version_select at 0x7fb24fc944c0>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:23.033204 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-452efd0f-9a2e-4669-936d-2e6f08ee4138 tempest-VolumesGetTestJSON-1513942985 tempest-VolumesGetTestJSON-1513942985-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/c465ae2e-a9dd-4924-8d82-a973529a4fac" status: 202 len: 0 microversion: 2.1 time: 0.430760 Nov 02 14:39:23.052777 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 3/6] 10.222.0.30 () {58 vars in 1248 bytes} [Wed Nov 2 14:39:22 2022] DELETE /compute/v2.1/os-volumes/c465ae2e-a9dd-4924-8d82-a973529a4fac => generated 0 bytes in 436 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:39:23.055035 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-d06d3569-b037-4f37-91cf-7813b549e881 tempest-VolumesGetTestJSON-1513942985 tempest-VolumesGetTestJSON-1513942985-project] Calling method '.version_select at 0x7fb24fee1c10>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:23.200549 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-d06d3569-b037-4f37-91cf-7813b549e881 tempest-VolumesGetTestJSON-1513942985 tempest-VolumesGetTestJSON-1513942985-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/c465ae2e-a9dd-4924-8d82-a973529a4fac" status: 200 len: 353 microversion: 2.1 time: 0.162014 Nov 02 14:39:23.201361 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 4/7] 10.222.0.30 () {58 vars in 1245 bytes} [Wed Nov 2 14:39:23 2022] GET /compute/v2.1/os-volumes/c465ae2e-a9dd-4924-8d82-a973529a4fac => generated 353 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:39:23.262627 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-dc7d7f4b-7aa7-441b-8f84-96e86e448779 tempest-VolumesTestJSON-399215457 tempest-VolumesTestJSON-399215457-project] Calling method '.version_select at 0x7fb24fc94b80>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:23.365100 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-dc7d7f4b-7aa7-441b-8f84-96e86e448779 tempest-VolumesTestJSON-399215457 tempest-VolumesTestJSON-399215457-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/f3ebf0c9-bda2-45cb-8d07-9f7167b982cf" status: 200 len: 350 microversion: 2.1 time: 0.106653 Nov 02 14:39:23.365668 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 4/8] 10.222.0.30 () {58 vars in 1245 bytes} [Wed Nov 2 14:39:23 2022] GET /compute/v2.1/os-volumes/f3ebf0c9-bda2-45cb-8d07-9f7167b982cf => generated 350 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:39:24.218770 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-f16ac7f4-873b-4175-ad05-50dde89cd95a tempest-VolumesGetTestJSON-1513942985 tempest-VolumesGetTestJSON-1513942985-project] Calling method '.version_select at 0x7fb24fcf5700>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:24.327073 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.wsgi [None req-f16ac7f4-873b-4175-ad05-50dde89cd95a tempest-VolumesGetTestJSON-1513942985 tempest-VolumesGetTestJSON-1513942985-project] HTTP exception thrown: Volume c465ae2e-a9dd-4924-8d82-a973529a4fac could not be found. Nov 02 14:39:24.334769 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-f16ac7f4-873b-4175-ad05-50dde89cd95a tempest-VolumesGetTestJSON-1513942985 tempest-VolumesGetTestJSON-1513942985-project] Request method failure captured: Nov 02 14:39:24.334769 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: request: GET /compute/v2.1/os-volumes/c465ae2e-a9dd-4924-8d82-a973529a4fac HTTP/1.1 Nov 02 14:39:24.334769 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Accept: application/json Nov 02 14:39:24.334769 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Accept-Encoding: identity Nov 02 14:39:24.334769 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Connection: close Nov 02 14:39:24.334769 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Content-Length: 0 Nov 02 14:39:24.334769 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Content-Type: application/json Nov 02 14:39:24.334769 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Host: 10.222.0.30 Nov 02 14:39:24.334769 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Openstack-System-Scope: None Nov 02 14:39:24.334769 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: User-Agent: python-urllib3/1.26.12 Nov 02 14:39:24.334769 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Auth-Token: gAAAAABjYoEVfNU9E3xtLGiWZtvARfLu3hs165NM2n5CXkhLdg5s6crFlS2DeK9fiIhKPWuUOC5uvqdkFoO3ouZT40gBUnxW5CwuoPs1wBX5aBsnXlNJxEwXWx2QXHGsFbb7UT9DJLu6d-3BG7CziaaIhbeHRWjZJ1dms7LaOncZLA7dL_6C3rY Nov 02 14:39:24.334769 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Domain-Id: None Nov 02 14:39:24.334769 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Domain-Name: None Nov 02 14:39:24.334769 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Identity-Status: Confirmed Nov 02 14:39:24.334769 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Is-Admin-Project: True Nov 02 14:39:24.334769 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Domain-Id: default Nov 02 14:39:24.334769 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Domain-Name: Default Nov 02 14:39:24.334769 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Id: 60c52c5ab5864f5094b8c170cbb9f81c Nov 02 14:39:24.334769 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Name: tempest-VolumesGetTestJSON-1513942985 Nov 02 14:39:24.334769 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Role: reader,member Nov 02 14:39:24.334769 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Roles: reader,member Nov 02 14:39:24.336456 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/60c52c5ab5864f5094b8c170cbb9f81c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/60c52c5ab5864f5094b8c170cbb9f81c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/60c52c5ab5864f5094b8c170cbb9f81c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_60c52c5ab5864f5094b8c170cbb9f81c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:39:24.336456 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant: tempest-VolumesGetTestJSON-1513942985 Nov 02 14:39:24.336456 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant-Id: 60c52c5ab5864f5094b8c170cbb9f81c Nov 02 14:39:24.336456 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant-Name: tempest-VolumesGetTestJSON-1513942985 Nov 02 14:39:24.336456 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User: tempest-VolumesGetTestJSON-1513942985-project Nov 02 14:39:24.336456 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Domain-Id: default Nov 02 14:39:24.336456 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Domain-Name: Default Nov 02 14:39:24.336456 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Id: 0e97852d54174b04a15fe45286d19879 Nov 02 14:39:24.336456 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Name: tempest-VolumesGetTestJSON-1513942985-project Nov 02 14:39:24.336456 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: method: Nov 02 14:39:24.336456 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: exception: Volume c465ae2e-a9dd-4924-8d82-a973529a4fac could not be found. Nov 02 14:39:24.336456 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: action_args: {'id': 'c465ae2e-a9dd-4924-8d82-a973529a4fac'} Nov 02 14:39:24.336456 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:39:24.338844 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:39:24.338844 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 14:39:24.338844 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 14:39:24.338844 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 14:39:24.338844 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 14:39:24.338844 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 14:39:24.338844 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 14:39:24.338844 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 14:39:24.338844 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 14:39:24.338844 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 14:39:24.338844 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 14:39:24.338844 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 14:39:24.338844 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 14:39:24.338844 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 14:39:24.338844 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 14:39:24.338844 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c465ae2e-a9dd-4924-8d82-a973529a4fac could not be found. (HTTP 404) (Request-ID: req-7954d8ab-5f62-4727-af10-1710495200f3) Nov 02 14:39:24.338844 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:39:24.338844 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:39:24.338844 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:39:24.340347 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:39:24.340347 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Nov 02 14:39:24.340347 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Nov 02 14:39:24.340347 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 14:39:24.340347 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 14:39:24.340347 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 14:39:24.340347 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 14:39:24.340347 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 14:39:24.340347 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 14:39:24.340347 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 14:39:24.340347 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 14:39:24.340347 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 14:39:24.340347 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 14:39:24.340347 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 14:39:24.340347 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 14:39:24.340347 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 14:39:24.340347 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 14:39:24.340347 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 14:39:24.340347 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 14:39:24.341807 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 14:39:24.341807 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 14:39:24.341807 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 14:39:24.341807 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 14:39:24.341807 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c465ae2e-a9dd-4924-8d82-a973529a4fac could not be found. Nov 02 14:39:24.341807 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:39:24.341807 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:39:24.341807 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:39:24.341807 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:39:24.341807 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:39:24.341807 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:39:24.341807 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:39:24.341807 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:39:24.341807 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 14:39:24.341807 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 14:39:24.341807 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:39:24.341807 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:39:24.341807 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Nov 02 14:39:24.341807 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:39:24.343244 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c465ae2e-a9dd-4924-8d82-a973529a4fac could not be found. Nov 02 14:39:24.343244 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:39:24.343244 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:39:24.343244 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:39:24.343244 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:39:24.343244 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:39:24.343244 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:39:24.343244 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:39:24.343244 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:39:24.343244 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c465ae2e-a9dd-4924-8d82-a973529a4fac could not be found. Nov 02 14:39:24.343244 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:39:24.343244 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-f16ac7f4-873b-4175-ad05-50dde89cd95a tempest-VolumesGetTestJSON-1513942985 tempest-VolumesGetTestJSON-1513942985-project] Returning 404 to user: Volume c465ae2e-a9dd-4924-8d82-a973529a4fac could not be found. {{(pid=119659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:39:24.343244 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-f16ac7f4-873b-4175-ad05-50dde89cd95a tempest-VolumesGetTestJSON-1513942985 tempest-VolumesGetTestJSON-1513942985-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/c465ae2e-a9dd-4924-8d82-a973529a4fac" status: 404 len: 109 microversion: 2.1 time: 0.127022 Nov 02 14:39:24.349233 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 5/9] 10.222.0.30 () {58 vars in 1245 bytes} [Wed Nov 2 14:39:24 2022] GET /compute/v2.1/os-volumes/c465ae2e-a9dd-4924-8d82-a973529a4fac => generated 109 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:39:25.616429 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-6d1e69dd-5e7e-4e1e-853d-3bec527e243d tempest-VolumesTestJSON-399215457 tempest-VolumesTestJSON-399215457-project] Calling method '.version_select at 0x7fb24fd00ca0>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:25.772121 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-6d1e69dd-5e7e-4e1e-853d-3bec527e243d tempest-VolumesTestJSON-399215457 tempest-VolumesTestJSON-399215457-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/e7229c3c-7737-437e-9a86-23afeb20f54f" status: 200 len: 351 microversion: 2.1 time: 0.165175 Nov 02 14:39:25.773542 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 5/10] 10.222.0.30 () {58 vars in 1245 bytes} [Wed Nov 2 14:39:25 2022] GET /compute/v2.1/os-volumes/e7229c3c-7737-437e-9a86-23afeb20f54f => generated 351 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:39:25.799930 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-2cc25fd3-db8e-406b-8891-c91122fe7d3c tempest-VolumesTestJSON-399215457 tempest-VolumesTestJSON-399215457-project] Calling method '.version_select at 0x7fb24fc635e0>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:25.985727 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-2cc25fd3-db8e-406b-8891-c91122fe7d3c tempest-VolumesTestJSON-399215457 tempest-VolumesTestJSON-399215457-project] 10.222.0.30 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.198635 Nov 02 14:39:25.985727 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 6/11] 10.222.0.30 () {58 vars in 1134 bytes} [Wed Nov 2 14:39:25 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:26.005287 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-92df2f70-b49a-4906-949f-559f4bf7893d tempest-VolumesTestJSON-399215457 tempest-VolumesTestJSON-399215457-project] Calling method '.version_select at 0x7fb24fc94940>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:26.263489 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-92df2f70-b49a-4906-949f-559f4bf7893d tempest-VolumesTestJSON-399215457 tempest-VolumesTestJSON-399215457-project] 10.222.0.30 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.267485 Nov 02 14:39:26.265178 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 6/12] 10.222.0.30 () {58 vars in 1149 bytes} [Wed Nov 2 14:39:25 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:39:26.284056 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-0ffc3bc9-fb78-4f03-ab5f-800914d5ae32 tempest-VolumesTestJSON-399215457 tempest-VolumesTestJSON-399215457-project] Calling method '.version_select at 0x7fb24fc63700>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:26.608513 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-0ffc3bc9-fb78-4f03-ab5f-800914d5ae32 tempest-VolumesTestJSON-399215457 tempest-VolumesTestJSON-399215457-project] 10.222.0.30 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.332105 Nov 02 14:39:26.609224 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 7/13] 10.222.0.30 () {58 vars in 1134 bytes} [Wed Nov 2 14:39:26 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:26.629142 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-b533c1d0-709e-4ab6-87cd-bf3e078b3bdc tempest-VolumesTestJSON-399215457 tempest-VolumesTestJSON-399215457-project] Calling method '.version_select at 0x7fb24fc9e790>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:26.876544 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-b533c1d0-709e-4ab6-87cd-bf3e078b3bdc tempest-VolumesTestJSON-399215457 tempest-VolumesTestJSON-399215457-project] 10.222.0.30 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.256557 Nov 02 14:39:26.877461 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 7/14] 10.222.0.30 () {58 vars in 1167 bytes} [Wed Nov 2 14:39:26 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:39:26.897124 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-fefc24bb-7371-451b-abf0-43b810975173 tempest-VolumesTestJSON-399215457 tempest-VolumesTestJSON-399215457-project] Calling method '.version_select at 0x7fb24fc7fc10>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:27.111472 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-fefc24bb-7371-451b-abf0-43b810975173 tempest-VolumesTestJSON-399215457 tempest-VolumesTestJSON-399215457-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.220234 Nov 02 14:39:27.112695 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 8/15] 10.222.0.30 () {58 vars in 1170 bytes} [Wed Nov 2 14:39:26 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:39:27.128228 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-9aae8ede-e0f8-40fc-b104-1c1d42cc3f20 tempest-VolumesTestJSON-399215457 tempest-VolumesTestJSON-399215457-project] Calling method '.version_select at 0x7fb24fc9e550>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:27.289738 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-9aae8ede-e0f8-40fc-b104-1c1d42cc3f20 tempest-VolumesTestJSON-399215457 tempest-VolumesTestJSON-399215457-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.166327 Nov 02 14:39:27.299046 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 8/16] 10.222.0.30 () {58 vars in 1155 bytes} [Wed Nov 2 14:39:27 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:27.306172 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-45a8acb0-88a5-42a0-bda1-2aef5a55bc2a tempest-VolumesTestJSON-399215457 tempest-VolumesTestJSON-399215457-project] Calling method '.version_select at 0x7fb24fc7f820>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:27.465671 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-45a8acb0-88a5-42a0-bda1-2aef5a55bc2a tempest-VolumesTestJSON-399215457 tempest-VolumesTestJSON-399215457-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.165157 Nov 02 14:39:27.467345 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 9/17] 10.222.0.30 () {58 vars in 1188 bytes} [Wed Nov 2 14:39:27 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:39:27.482983 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-8f849bd9-1e4e-4e84-8288-13e5a44ea2d0 tempest-VolumesTestJSON-399215457 tempest-VolumesTestJSON-399215457-project] Calling method '.version_select at 0x7fb24fc94700>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:27.759827 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-8f849bd9-1e4e-4e84-8288-13e5a44ea2d0 tempest-VolumesTestJSON-399215457 tempest-VolumesTestJSON-399215457-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.282479 Nov 02 14:39:27.762234 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 9/18] 10.222.0.30 () {58 vars in 1155 bytes} [Wed Nov 2 14:39:27 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:31.863144 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-80003953-d8a0-40b6-a66b-c185ebe286e8 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1893371639", "imageRef": "a726a246-cc7f-46e6-aeff-4d62e03cc091", "flavorRef": "452", "networks": [{"uuid": "07b27265-9252-453e-b15b-5758b8087359"}]}} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:39:32.061767 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.network.neutron [None req-80003953-d8a0-40b6-a66b-c185ebe286e8 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] validate_networks() for [('07b27265-9252-453e-b15b-5758b8087359', None, None, None, None, None)] {{(pid=119659) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:39:33.052568 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-4195ed38-3ee7-4f8c-a4e9-95637cc25ca6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2012025532", "imageRef": "a726a246-cc7f-46e6-aeff-4d62e03cc091", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:39:33.262501 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.network.neutron [None req-4195ed38-3ee7-4f8c-a4e9-95637cc25ca6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] validate_networks() for [('bea7d5f3-3f34-426a-97bc-a8938ef4d97b', None, None, None, None, None)] {{(pid=119658) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:39:33.812870 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.virt.hardware [None req-80003953-d8a0-40b6-a66b-c185ebe286e8 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Flavor limits 0:0:0 {{(pid=119659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:39:33.813590 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.virt.hardware [None req-80003953-d8a0-40b6-a66b-c185ebe286e8 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Image limits 0:0:0 {{(pid=119659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:39:33.813987 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.virt.hardware [None req-80003953-d8a0-40b6-a66b-c185ebe286e8 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Flavor pref 0:0:0 {{(pid=119659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:39:33.814573 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.virt.hardware [None req-80003953-d8a0-40b6-a66b-c185ebe286e8 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Image pref 0:0:0 {{(pid=119659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:39:33.814992 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.virt.hardware [None req-80003953-d8a0-40b6-a66b-c185ebe286e8 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:39:33.832886 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-80003953-d8a0-40b6-a66b-c185ebe286e8 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:33.833480 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-80003953-d8a0-40b6-a66b-c185ebe286e8 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:33.834128 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-80003953-d8a0-40b6-a66b-c185ebe286e8 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:33.835212 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-80003953-d8a0-40b6-a66b-c185ebe286e8 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:33.835831 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-80003953-d8a0-40b6-a66b-c185ebe286e8 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:33.836437 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-80003953-d8a0-40b6-a66b-c185ebe286e8 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:33.879792 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.quota [None req-80003953-d8a0-40b6-a66b-c185ebe286e8 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Getting quotas for project b60403061fba42eba98a7c89987672a8. Resources: {'instances', 'ram', 'cores'} {{(pid=119659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:39:33.897328 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.quota [None req-80003953-d8a0-40b6-a66b-c185ebe286e8 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Getting quotas for user a8706e96002946b2b9bfe87de5c3271a and project b60403061fba42eba98a7c89987672a8. Resources: {'instances', 'ram', 'cores'} {{(pid=119659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:39:33.916554 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-80003953-d8a0-40b6-a66b-c185ebe286e8 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Going to run 1 instances... {{(pid=119659) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:39:33.919722 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-80003953-d8a0-40b6-a66b-c185ebe286e8 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] [instance: 1ffa9152-f022-466a-ab9b-9977066503d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a726a246-cc7f-46e6-aeff-4d62e03cc091',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119659) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:39:34.149769 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-80003953-d8a0-40b6-a66b-c185ebe286e8 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.939236 Nov 02 14:39:34.151085 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 10/19] 10.222.0.30 () {60 vars in 1147 bytes} [Wed Nov 2 14:39:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2942 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:39:34.837645 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-4195ed38-3ee7-4f8c-a4e9-95637cc25ca6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Flavor limits 0:0:0 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:39:34.838587 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-4195ed38-3ee7-4f8c-a4e9-95637cc25ca6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Image limits 0:0:0 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:39:34.839214 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-4195ed38-3ee7-4f8c-a4e9-95637cc25ca6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Flavor pref 0:0:0 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:39:34.839754 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-4195ed38-3ee7-4f8c-a4e9-95637cc25ca6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Image pref 0:0:0 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:39:34.840299 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-4195ed38-3ee7-4f8c-a4e9-95637cc25ca6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:39:34.870521 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4195ed38-3ee7-4f8c-a4e9-95637cc25ca6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:34.871315 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4195ed38-3ee7-4f8c-a4e9-95637cc25ca6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:34.873091 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4195ed38-3ee7-4f8c-a4e9-95637cc25ca6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:34.878364 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4195ed38-3ee7-4f8c-a4e9-95637cc25ca6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:34.879255 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4195ed38-3ee7-4f8c-a4e9-95637cc25ca6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:34.885133 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-625e9808-1423-4509-a707-4024e40b3349 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Action: 'create', calling method: .version_select at 0x7fb24fb72a60>, body: {"keypair": {"name": "tempest-keypair-1913832184", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCsXiatAijfbhhPapmo6ip2n+tgFH6XRpgIgGEGf8dTQdm4DQQiWnwHnmrbxlIp3DSnYdm4+trmijYH2477X//gICqUvy5nFUuWUSucz9v3NLBjLDL/a9UY0cl6fTQKKjw=="}} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:39:34.885625 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4195ed38-3ee7-4f8c-a4e9-95637cc25ca6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:34.958967 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.quota [None req-4195ed38-3ee7-4f8c-a4e9-95637cc25ca6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Getting quotas for project edc675d4a92f4ff9ae8a41a020fa792c. Resources: {'instances', 'ram', 'cores'} {{(pid=119658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:39:34.971982 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.quota [None req-625e9808-1423-4509-a707-4024e40b3349 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Getting quotas for project 0dd67ec4f08d4d548af5b5ccee50407c. Resources: {'key_pairs'} {{(pid=119659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:39:34.977378 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.quota [None req-4195ed38-3ee7-4f8c-a4e9-95637cc25ca6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Getting quotas for user 921ba33e2e0740278b7b6fb4af248363 and project edc675d4a92f4ff9ae8a41a020fa792c. Resources: {'instances', 'ram', 'cores'} {{(pid=119658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:39:34.978922 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.quota [None req-625e9808-1423-4509-a707-4024e40b3349 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Getting quotas for user eb0b112497dc4b64a9ea2f09f808646d and project 0dd67ec4f08d4d548af5b5ccee50407c. Resources: {'key_pairs'} {{(pid=119659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:39:35.047650 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-4195ed38-3ee7-4f8c-a4e9-95637cc25ca6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Going to run 1 instances... {{(pid=119658) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:39:35.050858 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-4195ed38-3ee7-4f8c-a4e9-95637cc25ca6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 803e6b19-d962-4158-9a6c-e38cbd2b3e04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a726a246-cc7f-46e6-aeff-4d62e03cc091',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119658) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:39:35.166635 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-625e9808-1423-4509-a707-4024e40b3349 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.013992 Nov 02 14:39:35.167734 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 11/20] 10.222.0.30 () {62 vars in 1200 bytes} [Wed Nov 2 14:39:34 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1016 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 14:39:35.174423 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-70416ed8-79f2-412d-94a7-d9d7b6645afa tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:35.187387 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-70416ed8-79f2-412d-94a7-d9d7b6645afa tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] [instance: 1ffa9152-f022-466a-ab9b-9977066503d0] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:35.341438 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-4195ed38-3ee7-4f8c-a4e9-95637cc25ca6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.761175 Nov 02 14:39:35.351792 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 10/21] 10.222.0.30 () {60 vars in 1147 bytes} [Wed Nov 2 14:39:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 2772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:39:35.364609 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-e8f6fc85-39a5-4076-9193-77384baf1e60 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:35.364609 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-e8f6fc85-39a5-4076-9193-77384baf1e60 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 803e6b19-d962-4158-9a6c-e38cbd2b3e04] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:35.394135 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-70416ed8-79f2-412d-94a7-d9d7b6645afa tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8706e96002946b2b9bfe87de5c3271a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60403061fba42eba98a7c89987672a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:35.430041 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-70416ed8-79f2-412d-94a7-d9d7b6645afa tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] 10.222.0.30 "GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0" status: 200 len: 1215 microversion: 2.1 time: 0.261046 Nov 02 14:39:35.430681 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 12/22] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:35 2022] GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0 => generated 1215 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:35.475906 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-e8f6fc85-39a5-4076-9193-77384baf1e60 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:35.499057 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-e8f6fc85-39a5-4076-9193-77384baf1e60 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04" status: 200 len: 1222 microversion: 2.1 time: 0.145139 Nov 02 14:39:35.500400 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 11/23] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:35 2022] GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04 => generated 1222 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:36.238299 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-1d768fc9-688c-4844-921e-7fae40cc6362 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2102311822", "imageRef": "a726a246-cc7f-46e6-aeff-4d62e03cc091", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:39:36.462727 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-64022263-c324-47fe-8e16-9739936d9188 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:36.463591 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-64022263-c324-47fe-8e16-9739936d9188 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] [instance: 1ffa9152-f022-466a-ab9b-9977066503d0] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:36.490679 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.network.neutron [None req-1d768fc9-688c-4844-921e-7fae40cc6362 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] validate_networks() for [('bea7d5f3-3f34-426a-97bc-a8938ef4d97b', None, None, None, None, None)] {{(pid=119659) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:39:36.769815 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-64022263-c324-47fe-8e16-9739936d9188 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8706e96002946b2b9bfe87de5c3271a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60403061fba42eba98a7c89987672a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:36.782896 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-64022263-c324-47fe-8e16-9739936d9188 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] 10.222.0.30 "GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0" status: 200 len: 1215 microversion: 2.1 time: 0.329433 Nov 02 14:39:36.784978 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 12/24] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:36 2022] GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0 => generated 1215 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:37.352321 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.virt.hardware [None req-1d768fc9-688c-4844-921e-7fae40cc6362 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Flavor limits 0:0:0 {{(pid=119659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:39:37.353774 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.virt.hardware [None req-1d768fc9-688c-4844-921e-7fae40cc6362 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Image limits 0:0:0 {{(pid=119659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:39:37.354510 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.virt.hardware [None req-1d768fc9-688c-4844-921e-7fae40cc6362 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Flavor pref 0:0:0 {{(pid=119659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:39:37.355125 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.virt.hardware [None req-1d768fc9-688c-4844-921e-7fae40cc6362 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Image pref 0:0:0 {{(pid=119659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:39:37.355765 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.virt.hardware [None req-1d768fc9-688c-4844-921e-7fae40cc6362 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:39:37.369625 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1d768fc9-688c-4844-921e-7fae40cc6362 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:37.371060 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1d768fc9-688c-4844-921e-7fae40cc6362 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:37.371060 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1d768fc9-688c-4844-921e-7fae40cc6362 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:37.371870 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1d768fc9-688c-4844-921e-7fae40cc6362 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:37.372569 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1d768fc9-688c-4844-921e-7fae40cc6362 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:37.373120 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1d768fc9-688c-4844-921e-7fae40cc6362 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:37.393119 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.quota [None req-1d768fc9-688c-4844-921e-7fae40cc6362 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Getting quotas for project edc675d4a92f4ff9ae8a41a020fa792c. Resources: {'instances', 'ram', 'cores'} {{(pid=119659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:39:37.398753 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.quota [None req-1d768fc9-688c-4844-921e-7fae40cc6362 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Getting quotas for user 921ba33e2e0740278b7b6fb4af248363 and project edc675d4a92f4ff9ae8a41a020fa792c. Resources: {'instances', 'ram', 'cores'} {{(pid=119659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:39:37.411634 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-1d768fc9-688c-4844-921e-7fae40cc6362 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Going to run 1 instances... {{(pid=119659) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:39:37.414234 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-1d768fc9-688c-4844-921e-7fae40cc6362 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a726a246-cc7f-46e6-aeff-4d62e03cc091',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119659) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:39:37.663721 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-1d768fc9-688c-4844-921e-7fae40cc6362 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.431537 Nov 02 14:39:37.681030 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 13/25] 10.222.0.30 () {60 vars in 1147 bytes} [Wed Nov 2 14:39:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 1449 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 14:39:37.684846 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-4c8ff1ca-4def-4016-875d-b48d04efa20a tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:37.685582 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-4c8ff1ca-4def-4016-875d-b48d04efa20a tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:37.811002 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-69c59c58-5713-4eec-8370-424ab8d20f90 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:37.811624 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-69c59c58-5713-4eec-8370-424ab8d20f90 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] [instance: 1ffa9152-f022-466a-ab9b-9977066503d0] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:37.928746 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-4c8ff1ca-4def-4016-875d-b48d04efa20a tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:37.947923 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-4c8ff1ca-4def-4016-875d-b48d04efa20a tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1222 microversion: 2.1 time: 0.264595 Nov 02 14:39:37.949901 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 13/26] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:37 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1222 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:39:38.092384 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-69c59c58-5713-4eec-8370-424ab8d20f90 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8706e96002946b2b9bfe87de5c3271a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60403061fba42eba98a7c89987672a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:38.106038 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-69c59c58-5713-4eec-8370-424ab8d20f90 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] 10.222.0.30 "GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0" status: 200 len: 1215 microversion: 2.1 time: 0.299565 Nov 02 14:39:38.142389 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 14/27] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:37 2022] GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0 => generated 1215 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:38.981469 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-2b6e0aef-994b-4d4f-b6dd-4398763e81c2 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:38.984168 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-2b6e0aef-994b-4d4f-b6dd-4398763e81c2 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:39.102676 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-2b6e0aef-994b-4d4f-b6dd-4398763e81c2 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:39.111523 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-2b6e0aef-994b-4d4f-b6dd-4398763e81c2 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1222 microversion: 2.1 time: 0.143314 Nov 02 14:39:39.112384 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 14/28] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:38 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1222 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:39.145130 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-2926dbfa-d01f-46d6-ba6b-075e5851cc3b tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:39.146431 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-2926dbfa-d01f-46d6-ba6b-075e5851cc3b tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] [instance: 1ffa9152-f022-466a-ab9b-9977066503d0] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:39.159820 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2926dbfa-d01f-46d6-ba6b-075e5851cc3b tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:39.177341 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2926dbfa-d01f-46d6-ba6b-075e5851cc3b tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:39.179902 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2926dbfa-d01f-46d6-ba6b-075e5851cc3b tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:39.181230 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2926dbfa-d01f-46d6-ba6b-075e5851cc3b tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:39.187185 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2926dbfa-d01f-46d6-ba6b-075e5851cc3b tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:39.188930 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2926dbfa-d01f-46d6-ba6b-075e5851cc3b tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:39.405643 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-2926dbfa-d01f-46d6-ba6b-075e5851cc3b tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8706e96002946b2b9bfe87de5c3271a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60403061fba42eba98a7c89987672a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:39.424772 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-2926dbfa-d01f-46d6-ba6b-075e5851cc3b tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] 10.222.0.30 "GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0" status: 200 len: 1211 microversion: 2.1 time: 0.290930 Nov 02 14:39:39.435383 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 15/29] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:39 2022] GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0 => generated 1211 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:40.137690 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-4766dc0b-6f94-4553-8578-8e11d2e74026 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:40.138827 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-4766dc0b-6f94-4553-8578-8e11d2e74026 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:40.147518 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4766dc0b-6f94-4553-8578-8e11d2e74026 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:40.148114 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4766dc0b-6f94-4553-8578-8e11d2e74026 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:40.148705 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4766dc0b-6f94-4553-8578-8e11d2e74026 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:40.149537 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4766dc0b-6f94-4553-8578-8e11d2e74026 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:40.150730 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4766dc0b-6f94-4553-8578-8e11d2e74026 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:40.152197 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4766dc0b-6f94-4553-8578-8e11d2e74026 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:40.434426 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-4766dc0b-6f94-4553-8578-8e11d2e74026 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:40.448808 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-82229228-468f-4f29-bb57-6489deb2a09c tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:40.451549 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-82229228-468f-4f29-bb57-6489deb2a09c tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] [instance: 1ffa9152-f022-466a-ab9b-9977066503d0] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:40.453436 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-4766dc0b-6f94-4553-8578-8e11d2e74026 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1218 microversion: 2.1 time: 0.319409 Nov 02 14:39:40.454132 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 15/30] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:40 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1218 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:40.462267 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-82229228-468f-4f29-bb57-6489deb2a09c tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:40.462785 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-82229228-468f-4f29-bb57-6489deb2a09c tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:40.463241 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-82229228-468f-4f29-bb57-6489deb2a09c tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:40.463930 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-82229228-468f-4f29-bb57-6489deb2a09c tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:40.464380 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-82229228-468f-4f29-bb57-6489deb2a09c tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:40.464804 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-82229228-468f-4f29-bb57-6489deb2a09c tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:40.547054 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-82229228-468f-4f29-bb57-6489deb2a09c tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8706e96002946b2b9bfe87de5c3271a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60403061fba42eba98a7c89987672a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:40.563436 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-1dbc4873-4c5a-496d-833a-666967c1466e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-181803220", "imageRef": "a726a246-cc7f-46e6-aeff-4d62e03cc091", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f2e46242-b4bc-49aa-9edc-2954b80ac8ba"}], "security_groups": [{"name": "tempest-securitygroup--1527162610"}], "key_name": "tempest-keypair-1913832184", "user_data": "}} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:39:40.570625 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-82229228-468f-4f29-bb57-6489deb2a09c tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] 10.222.0.30 "GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0" status: 200 len: 1275 microversion: 2.1 time: 0.126664 Nov 02 14:39:40.573718 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 16/31] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:40 2022] GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0 => generated 1275 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:39:40.820901 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.network.neutron [None req-1dbc4873-4c5a-496d-833a-666967c1466e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] validate_networks() for [('f2e46242-b4bc-49aa-9edc-2954b80ac8ba', None, None, None, None, None)] {{(pid=119658) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:39:41.356216 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-1dbc4873-4c5a-496d-833a-666967c1466e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Flavor limits 0:0:0 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:39:41.356778 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-1dbc4873-4c5a-496d-833a-666967c1466e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Image limits 0:0:0 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:39:41.357274 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-1dbc4873-4c5a-496d-833a-666967c1466e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Flavor pref 0:0:0 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:39:41.357687 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-1dbc4873-4c5a-496d-833a-666967c1466e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Image pref 0:0:0 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:39:41.358120 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-1dbc4873-4c5a-496d-833a-666967c1466e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:39:41.371465 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1dbc4873-4c5a-496d-833a-666967c1466e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:41.372057 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1dbc4873-4c5a-496d-833a-666967c1466e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:41.372483 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1dbc4873-4c5a-496d-833a-666967c1466e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:41.373238 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1dbc4873-4c5a-496d-833a-666967c1466e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:41.373748 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1dbc4873-4c5a-496d-833a-666967c1466e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:41.374197 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1dbc4873-4c5a-496d-833a-666967c1466e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:41.402130 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.quota [None req-1dbc4873-4c5a-496d-833a-666967c1466e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Getting quotas for project 0dd67ec4f08d4d548af5b5ccee50407c. Resources: {'instances', 'ram', 'cores'} {{(pid=119658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:39:41.407418 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.quota [None req-1dbc4873-4c5a-496d-833a-666967c1466e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Getting quotas for user eb0b112497dc4b64a9ea2f09f808646d and project 0dd67ec4f08d4d548af5b5ccee50407c. Resources: {'instances', 'ram', 'cores'} {{(pid=119658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:39:41.419696 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-1dbc4873-4c5a-496d-833a-666967c1466e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Going to run 1 instances... {{(pid=119658) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:39:41.424455 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-1dbc4873-4c5a-496d-833a-666967c1466e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a726a246-cc7f-46e6-aeff-4d62e03cc091',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119658) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:39:41.483275 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-9c8d6269-c163-4210-9097-8c6f071c6d64 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:41.484016 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-9c8d6269-c163-4210-9097-8c6f071c6d64 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:41.495183 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9c8d6269-c163-4210-9097-8c6f071c6d64 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:41.498338 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9c8d6269-c163-4210-9097-8c6f071c6d64 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:41.498860 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9c8d6269-c163-4210-9097-8c6f071c6d64 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:41.502451 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9c8d6269-c163-4210-9097-8c6f071c6d64 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:41.503598 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9c8d6269-c163-4210-9097-8c6f071c6d64 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:41.504363 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9c8d6269-c163-4210-9097-8c6f071c6d64 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:41.591323 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-9c8d6269-c163-4210-9097-8c6f071c6d64 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:41.602498 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-9c8d6269-c163-4210-9097-8c6f071c6d64 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1218 microversion: 2.1 time: 0.125805 Nov 02 14:39:41.603693 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 17/32] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:41 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1218 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:41.608655 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-d067270a-8de1-4466-b680-51b0c417e150 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:41.609969 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-d067270a-8de1-4466-b680-51b0c417e150 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] [instance: 1ffa9152-f022-466a-ab9b-9977066503d0] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:41.616029 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d067270a-8de1-4466-b680-51b0c417e150 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:41.616513 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d067270a-8de1-4466-b680-51b0c417e150 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:41.617112 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d067270a-8de1-4466-b680-51b0c417e150 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:41.617952 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d067270a-8de1-4466-b680-51b0c417e150 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:41.618777 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d067270a-8de1-4466-b680-51b0c417e150 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:41.619265 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d067270a-8de1-4466-b680-51b0c417e150 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:41.691415 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-1dbc4873-4c5a-496d-833a-666967c1466e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.140238 Nov 02 14:39:41.692859 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 16/33] 10.222.0.30 () {62 vars in 1188 bytes} [Wed Nov 2 14:39:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 1142 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Nov 02 14:39:41.705636 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-e4d6f202-a4a2-4791-87cc-e3bd2a4d2a35 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:41.706521 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-e4d6f202-a4a2-4791-87cc-e3bd2a4d2a35 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:41.782698 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-d067270a-8de1-4466-b680-51b0c417e150 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8706e96002946b2b9bfe87de5c3271a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60403061fba42eba98a7c89987672a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:41.792244 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-d067270a-8de1-4466-b680-51b0c417e150 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] 10.222.0.30 "GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0" status: 200 len: 1273 microversion: 2.1 time: 0.187304 Nov 02 14:39:41.793864 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 18/34] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:41 2022] GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0 => generated 1273 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:41.852766 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-e4d6f202-a4a2-4791-87cc-e3bd2a4d2a35 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:41.921311 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-e4d6f202-a4a2-4791-87cc-e3bd2a4d2a35 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:41.932098 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-e4d6f202-a4a2-4791-87cc-e3bd2a4d2a35 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:41.941998 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-e4d6f202-a4a2-4791-87cc-e3bd2a4d2a35 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1281 microversion: 2.20 time: 0.237279 Nov 02 14:39:41.944257 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 17/35] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:39:41 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1281 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:39:42.632078 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-cb1e0c0b-a9b4-495d-adb5-bfec89334dff tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:42.633403 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-cb1e0c0b-a9b4-495d-adb5-bfec89334dff tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:42.642727 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-cb1e0c0b-a9b4-495d-adb5-bfec89334dff tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:42.643546 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-cb1e0c0b-a9b4-495d-adb5-bfec89334dff tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:42.644390 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-cb1e0c0b-a9b4-495d-adb5-bfec89334dff tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:42.645468 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-cb1e0c0b-a9b4-495d-adb5-bfec89334dff tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:42.646206 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-cb1e0c0b-a9b4-495d-adb5-bfec89334dff tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:42.646816 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-cb1e0c0b-a9b4-495d-adb5-bfec89334dff tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:42.778177 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-cb1e0c0b-a9b4-495d-adb5-bfec89334dff tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:42.786477 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-cb1e0c0b-a9b4-495d-adb5-bfec89334dff tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1274 microversion: 2.1 time: 0.158300 Nov 02 14:39:42.789222 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 19/36] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:42 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1274 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:42.816606 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-3aaec948-46f0-4b87-a186-06a1f89d321e tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:42.817332 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-3aaec948-46f0-4b87-a186-06a1f89d321e tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] [instance: 1ffa9152-f022-466a-ab9b-9977066503d0] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:42.823571 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3aaec948-46f0-4b87-a186-06a1f89d321e tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:42.824059 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3aaec948-46f0-4b87-a186-06a1f89d321e tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:42.824499 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3aaec948-46f0-4b87-a186-06a1f89d321e tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:42.825239 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3aaec948-46f0-4b87-a186-06a1f89d321e tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:42.825695 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3aaec948-46f0-4b87-a186-06a1f89d321e tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:42.826126 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3aaec948-46f0-4b87-a186-06a1f89d321e tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:42.976695 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-fcf86794-9c45-49be-952d-73a973f87a27 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:42.977761 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-fcf86794-9c45-49be-952d-73a973f87a27 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:43.106535 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-fcf86794-9c45-49be-952d-73a973f87a27 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:43.117972 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-fcf86794-9c45-49be-952d-73a973f87a27 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:43.121538 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-fcf86794-9c45-49be-952d-73a973f87a27 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:43.123421 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-fcf86794-9c45-49be-952d-73a973f87a27 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1281 microversion: 2.20 time: 0.153587 Nov 02 14:39:43.142028 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 20/37] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:39:42 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1281 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:39:43.219509 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-3aaec948-46f0-4b87-a186-06a1f89d321e tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8706e96002946b2b9bfe87de5c3271a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60403061fba42eba98a7c89987672a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:43.227556 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-3aaec948-46f0-4b87-a186-06a1f89d321e tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] 10.222.0.30 "GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0" status: 200 len: 1315 microversion: 2.1 time: 0.415484 Nov 02 14:39:43.228602 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 18/38] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:42 2022] GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0 => generated 1315 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:43.810771 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-359bfbdd-5479-401e-9f57-2e85b297648c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:43.812868 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-359bfbdd-5479-401e-9f57-2e85b297648c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:43.818386 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-359bfbdd-5479-401e-9f57-2e85b297648c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:43.818948 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-359bfbdd-5479-401e-9f57-2e85b297648c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:43.819449 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-359bfbdd-5479-401e-9f57-2e85b297648c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:43.820380 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-359bfbdd-5479-401e-9f57-2e85b297648c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:43.820947 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-359bfbdd-5479-401e-9f57-2e85b297648c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:43.821771 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-359bfbdd-5479-401e-9f57-2e85b297648c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:43.897851 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-359bfbdd-5479-401e-9f57-2e85b297648c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:43.908066 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-359bfbdd-5479-401e-9f57-2e85b297648c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1274 microversion: 2.1 time: 0.100485 Nov 02 14:39:43.908688 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 21/39] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:43 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1274 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:44.151600 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-4d8f363f-d043-49a4-98d6-c1b92ee12f05 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:44.152210 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-4d8f363f-d043-49a4-98d6-c1b92ee12f05 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:44.158590 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4d8f363f-d043-49a4-98d6-c1b92ee12f05 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:44.159075 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4d8f363f-d043-49a4-98d6-c1b92ee12f05 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:44.159513 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4d8f363f-d043-49a4-98d6-c1b92ee12f05 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:44.160197 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4d8f363f-d043-49a4-98d6-c1b92ee12f05 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:44.160644 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4d8f363f-d043-49a4-98d6-c1b92ee12f05 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:44.161092 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4d8f363f-d043-49a4-98d6-c1b92ee12f05 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:44.222386 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-4d8f363f-d043-49a4-98d6-c1b92ee12f05 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:44.230969 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-4d8f363f-d043-49a4-98d6-c1b92ee12f05 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:44.232427 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-4d8f363f-d043-49a4-98d6-c1b92ee12f05 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:44.233560 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-4d8f363f-d043-49a4-98d6-c1b92ee12f05 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1285 microversion: 2.20 time: 0.085831 Nov 02 14:39:44.235706 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 19/40] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:39:44 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:39:44.258713 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-fbb71b93-7276-49a6-81a0-9587c571f8e8 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:44.260730 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-fbb71b93-7276-49a6-81a0-9587c571f8e8 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] [instance: 1ffa9152-f022-466a-ab9b-9977066503d0] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:44.267017 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fbb71b93-7276-49a6-81a0-9587c571f8e8 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:44.267481 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fbb71b93-7276-49a6-81a0-9587c571f8e8 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:44.267961 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fbb71b93-7276-49a6-81a0-9587c571f8e8 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:44.268669 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fbb71b93-7276-49a6-81a0-9587c571f8e8 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:44.269213 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fbb71b93-7276-49a6-81a0-9587c571f8e8 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:44.269670 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fbb71b93-7276-49a6-81a0-9587c571f8e8 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:44.415380 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-fbb71b93-7276-49a6-81a0-9587c571f8e8 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8706e96002946b2b9bfe87de5c3271a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60403061fba42eba98a7c89987672a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:44.423816 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-fbb71b93-7276-49a6-81a0-9587c571f8e8 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] 10.222.0.30 "GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0" status: 200 len: 1315 microversion: 2.1 time: 0.168962 Nov 02 14:39:44.424838 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 22/41] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:44 2022] GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:44.935277 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-0fb2bbfc-a331-4f86-994d-1e6818873d9a tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:44.937739 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-0fb2bbfc-a331-4f86-994d-1e6818873d9a tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:44.943779 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0fb2bbfc-a331-4f86-994d-1e6818873d9a tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:44.944267 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0fb2bbfc-a331-4f86-994d-1e6818873d9a tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:44.944702 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0fb2bbfc-a331-4f86-994d-1e6818873d9a tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:44.945422 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0fb2bbfc-a331-4f86-994d-1e6818873d9a tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:44.945874 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0fb2bbfc-a331-4f86-994d-1e6818873d9a tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:44.946300 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0fb2bbfc-a331-4f86-994d-1e6818873d9a tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:45.032929 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-0fb2bbfc-a331-4f86-994d-1e6818873d9a tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:45.042500 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-0fb2bbfc-a331-4f86-994d-1e6818873d9a tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1274 microversion: 2.1 time: 0.110787 Nov 02 14:39:45.051462 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 20/42] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:44 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1274 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:45.260125 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-e8aaf3a3-4164-4772-aac7-f116fa3d6d4d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:45.271460 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-e8aaf3a3-4164-4772-aac7-f116fa3d6d4d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:45.271460 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e8aaf3a3-4164-4772-aac7-f116fa3d6d4d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:45.271460 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e8aaf3a3-4164-4772-aac7-f116fa3d6d4d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:45.271460 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e8aaf3a3-4164-4772-aac7-f116fa3d6d4d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:45.271909 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e8aaf3a3-4164-4772-aac7-f116fa3d6d4d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:45.271909 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e8aaf3a3-4164-4772-aac7-f116fa3d6d4d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:45.271909 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e8aaf3a3-4164-4772-aac7-f116fa3d6d4d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:45.385454 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-e8aaf3a3-4164-4772-aac7-f116fa3d6d4d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:45.385454 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-e8aaf3a3-4164-4772-aac7-f116fa3d6d4d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:45.385828 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-e8aaf3a3-4164-4772-aac7-f116fa3d6d4d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:45.385828 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-e8aaf3a3-4164-4772-aac7-f116fa3d6d4d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1285 microversion: 2.20 time: 0.117890 Nov 02 14:39:45.385828 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 23/43] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:39:45 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1285 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:39:45.446911 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-13c1cad0-441b-47ec-9810-9869131636de tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:45.447669 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-13c1cad0-441b-47ec-9810-9869131636de tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] [instance: 1ffa9152-f022-466a-ab9b-9977066503d0] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:45.453936 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-13c1cad0-441b-47ec-9810-9869131636de tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:45.454427 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-13c1cad0-441b-47ec-9810-9869131636de tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:45.454898 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-13c1cad0-441b-47ec-9810-9869131636de tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:45.455723 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-13c1cad0-441b-47ec-9810-9869131636de tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:45.456158 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-13c1cad0-441b-47ec-9810-9869131636de tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:45.456648 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-13c1cad0-441b-47ec-9810-9869131636de tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:45.646628 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-13c1cad0-441b-47ec-9810-9869131636de tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8706e96002946b2b9bfe87de5c3271a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60403061fba42eba98a7c89987672a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:45.655346 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-13c1cad0-441b-47ec-9810-9869131636de tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] 10.222.0.30 "GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0" status: 200 len: 1315 microversion: 2.1 time: 0.212163 Nov 02 14:39:45.669028 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 21/44] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:45 2022] GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0 => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:46.066892 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-d6f56121-4a84-416c-9cb1-db5c646fb3c6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:46.067834 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-d6f56121-4a84-416c-9cb1-db5c646fb3c6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:46.075034 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d6f56121-4a84-416c-9cb1-db5c646fb3c6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:46.075522 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d6f56121-4a84-416c-9cb1-db5c646fb3c6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:46.075960 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d6f56121-4a84-416c-9cb1-db5c646fb3c6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:46.076652 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d6f56121-4a84-416c-9cb1-db5c646fb3c6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:46.077209 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d6f56121-4a84-416c-9cb1-db5c646fb3c6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:46.078221 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d6f56121-4a84-416c-9cb1-db5c646fb3c6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:46.148257 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-d6f56121-4a84-416c-9cb1-db5c646fb3c6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:46.157067 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-d6f56121-4a84-416c-9cb1-db5c646fb3c6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1282 microversion: 2.1 time: 0.094752 Nov 02 14:39:46.157667 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 24/45] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:46 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1282 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:46.408832 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-2a55a902-635e-447e-b432-993a90cc2c55 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:46.409140 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-2a55a902-635e-447e-b432-993a90cc2c55 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:46.417157 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2a55a902-635e-447e-b432-993a90cc2c55 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:46.418036 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2a55a902-635e-447e-b432-993a90cc2c55 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:46.418734 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2a55a902-635e-447e-b432-993a90cc2c55 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:46.419756 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2a55a902-635e-447e-b432-993a90cc2c55 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:46.420371 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2a55a902-635e-447e-b432-993a90cc2c55 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:46.420969 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2a55a902-635e-447e-b432-993a90cc2c55 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:46.506837 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-2a55a902-635e-447e-b432-993a90cc2c55 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:46.518871 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-2a55a902-635e-447e-b432-993a90cc2c55 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:46.520584 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-2a55a902-635e-447e-b432-993a90cc2c55 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:46.523634 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-2a55a902-635e-447e-b432-993a90cc2c55 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1285 microversion: 2.20 time: 0.119816 Nov 02 14:39:46.524681 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 22/46] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:39:46 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1285 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:39:46.679849 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-c85fafd5-1664-4a5d-ae85-0685a0e200f1 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:46.680489 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-c85fafd5-1664-4a5d-ae85-0685a0e200f1 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] [instance: 1ffa9152-f022-466a-ab9b-9977066503d0] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:46.686396 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c85fafd5-1664-4a5d-ae85-0685a0e200f1 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:46.687413 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c85fafd5-1664-4a5d-ae85-0685a0e200f1 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:46.688084 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c85fafd5-1664-4a5d-ae85-0685a0e200f1 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:46.688774 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c85fafd5-1664-4a5d-ae85-0685a0e200f1 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:46.689242 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c85fafd5-1664-4a5d-ae85-0685a0e200f1 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:46.689656 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c85fafd5-1664-4a5d-ae85-0685a0e200f1 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:46.828313 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-c85fafd5-1664-4a5d-ae85-0685a0e200f1 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8706e96002946b2b9bfe87de5c3271a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60403061fba42eba98a7c89987672a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:46.837159 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-c85fafd5-1664-4a5d-ae85-0685a0e200f1 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] 10.222.0.30 "GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0" status: 200 len: 1315 microversion: 2.1 time: 0.161175 Nov 02 14:39:46.837735 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 25/47] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:46 2022] GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:47.191687 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-3b742899-e04b-41a8-aee2-0adb4cce700e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:47.192500 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-3b742899-e04b-41a8-aee2-0adb4cce700e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:47.198959 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3b742899-e04b-41a8-aee2-0adb4cce700e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:47.199462 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3b742899-e04b-41a8-aee2-0adb4cce700e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:47.200540 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3b742899-e04b-41a8-aee2-0adb4cce700e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:47.201279 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3b742899-e04b-41a8-aee2-0adb4cce700e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:47.201767 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3b742899-e04b-41a8-aee2-0adb4cce700e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:47.202193 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3b742899-e04b-41a8-aee2-0adb4cce700e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:47.281281 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-3b742899-e04b-41a8-aee2-0adb4cce700e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:47.293600 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-3b742899-e04b-41a8-aee2-0adb4cce700e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1282 microversion: 2.1 time: 0.105582 Nov 02 14:39:47.294283 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 23/48] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:47 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1282 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:47.551098 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-02f48073-9494-4fa8-a650-8a3a91e13678 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:47.552235 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-02f48073-9494-4fa8-a650-8a3a91e13678 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:47.554751 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell0:SELECT=4 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:39:47.560090 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-02f48073-9494-4fa8-a650-8a3a91e13678 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:47.560708 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-02f48073-9494-4fa8-a650-8a3a91e13678 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:47.561235 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-02f48073-9494-4fa8-a650-8a3a91e13678 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:47.572390 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-02f48073-9494-4fa8-a650-8a3a91e13678 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:47.573281 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-02f48073-9494-4fa8-a650-8a3a91e13678 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:47.573965 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-02f48073-9494-4fa8-a650-8a3a91e13678 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:47.659630 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-02f48073-9494-4fa8-a650-8a3a91e13678 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:47.675779 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-02f48073-9494-4fa8-a650-8a3a91e13678 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:47.677413 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-02f48073-9494-4fa8-a650-8a3a91e13678 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:47.678613 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-02f48073-9494-4fa8-a650-8a3a91e13678 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1285 microversion: 2.20 time: 0.132578 Nov 02 14:39:47.679368 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 26/49] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:39:47 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1285 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:39:47.861491 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-4cff1834-2c50-43b5-8a04-3510fee67812 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:47.862250 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-4cff1834-2c50-43b5-8a04-3510fee67812 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] [instance: 1ffa9152-f022-466a-ab9b-9977066503d0] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:47.869163 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4cff1834-2c50-43b5-8a04-3510fee67812 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:47.870078 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4cff1834-2c50-43b5-8a04-3510fee67812 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:47.870905 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4cff1834-2c50-43b5-8a04-3510fee67812 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:47.871975 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4cff1834-2c50-43b5-8a04-3510fee67812 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:47.872590 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4cff1834-2c50-43b5-8a04-3510fee67812 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:47.873210 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4cff1834-2c50-43b5-8a04-3510fee67812 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:48.040261 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-4cff1834-2c50-43b5-8a04-3510fee67812 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8706e96002946b2b9bfe87de5c3271a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60403061fba42eba98a7c89987672a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:48.048237 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-4cff1834-2c50-43b5-8a04-3510fee67812 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] 10.222.0.30 "GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0" status: 200 len: 1315 microversion: 2.1 time: 0.191571 Nov 02 14:39:48.048880 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 24/50] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:47 2022] GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:48.316849 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-784d544c-ccf6-42e7-b8d2-ca1222e3da22 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:48.317513 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-784d544c-ccf6-42e7-b8d2-ca1222e3da22 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:48.324061 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-784d544c-ccf6-42e7-b8d2-ca1222e3da22 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:48.330675 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-784d544c-ccf6-42e7-b8d2-ca1222e3da22 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:48.330675 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-784d544c-ccf6-42e7-b8d2-ca1222e3da22 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:48.330675 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-784d544c-ccf6-42e7-b8d2-ca1222e3da22 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:48.330675 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-784d544c-ccf6-42e7-b8d2-ca1222e3da22 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:48.331038 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-784d544c-ccf6-42e7-b8d2-ca1222e3da22 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:48.398524 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-784d544c-ccf6-42e7-b8d2-ca1222e3da22 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:48.423205 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-784d544c-ccf6-42e7-b8d2-ca1222e3da22 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1282 microversion: 2.1 time: 0.110172 Nov 02 14:39:48.424123 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 27/51] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:48 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1282 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:48.705767 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-429721f0-6a27-44df-9e20-0cfdb3039a16 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:48.706818 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-429721f0-6a27-44df-9e20-0cfdb3039a16 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:48.717927 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-429721f0-6a27-44df-9e20-0cfdb3039a16 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:48.718827 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-429721f0-6a27-44df-9e20-0cfdb3039a16 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:48.719434 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-429721f0-6a27-44df-9e20-0cfdb3039a16 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:48.721195 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-429721f0-6a27-44df-9e20-0cfdb3039a16 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:48.722096 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-429721f0-6a27-44df-9e20-0cfdb3039a16 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:48.722611 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-429721f0-6a27-44df-9e20-0cfdb3039a16 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:49.056330 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-429721f0-6a27-44df-9e20-0cfdb3039a16 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:49.056330 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-429721f0-6a27-44df-9e20-0cfdb3039a16 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:49.057216 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-429721f0-6a27-44df-9e20-0cfdb3039a16 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:49.057216 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-429721f0-6a27-44df-9e20-0cfdb3039a16 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1285 microversion: 2.20 time: 0.106012 Nov 02 14:39:49.057216 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 25/52] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:39:48 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1285 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:39:49.078210 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-5ea8af6f-49ac-4303-8bed-32f23f6c72b2 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:49.078839 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-5ea8af6f-49ac-4303-8bed-32f23f6c72b2 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] [instance: 1ffa9152-f022-466a-ab9b-9977066503d0] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:49.087889 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5ea8af6f-49ac-4303-8bed-32f23f6c72b2 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:49.087889 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5ea8af6f-49ac-4303-8bed-32f23f6c72b2 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:49.087889 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5ea8af6f-49ac-4303-8bed-32f23f6c72b2 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:49.088392 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5ea8af6f-49ac-4303-8bed-32f23f6c72b2 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:49.088766 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5ea8af6f-49ac-4303-8bed-32f23f6c72b2 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:49.089406 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5ea8af6f-49ac-4303-8bed-32f23f6c72b2 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:49.272039 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-5ea8af6f-49ac-4303-8bed-32f23f6c72b2 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8706e96002946b2b9bfe87de5c3271a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60403061fba42eba98a7c89987672a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:49.290617 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-5ea8af6f-49ac-4303-8bed-32f23f6c72b2 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] 10.222.0.30 "GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0" status: 200 len: 1315 microversion: 2.1 time: 0.216421 Nov 02 14:39:49.291442 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 28/53] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:49 2022] GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:49.456062 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-978370c9-7019-4c7d-ad9c-89dae623bbf3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:49.456711 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-978370c9-7019-4c7d-ad9c-89dae623bbf3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:49.463345 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-978370c9-7019-4c7d-ad9c-89dae623bbf3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:49.463832 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-978370c9-7019-4c7d-ad9c-89dae623bbf3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:49.464355 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-978370c9-7019-4c7d-ad9c-89dae623bbf3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:49.465094 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-978370c9-7019-4c7d-ad9c-89dae623bbf3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:49.465551 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-978370c9-7019-4c7d-ad9c-89dae623bbf3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:49.465968 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-978370c9-7019-4c7d-ad9c-89dae623bbf3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:49.537222 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-978370c9-7019-4c7d-ad9c-89dae623bbf3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:49.611811 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-978370c9-7019-4c7d-ad9c-89dae623bbf3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1282 microversion: 2.1 time: 0.159631 Nov 02 14:39:49.613195 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 26/54] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:49 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1282 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:50.068027 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-b5542bb3-60d0-4409-9007-a7586eb298ee tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:50.068027 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-b5542bb3-60d0-4409-9007-a7586eb298ee tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:50.075818 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b5542bb3-60d0-4409-9007-a7586eb298ee tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:50.076757 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b5542bb3-60d0-4409-9007-a7586eb298ee tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:50.079207 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b5542bb3-60d0-4409-9007-a7586eb298ee tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:50.080414 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b5542bb3-60d0-4409-9007-a7586eb298ee tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:50.080976 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b5542bb3-60d0-4409-9007-a7586eb298ee tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:50.087154 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b5542bb3-60d0-4409-9007-a7586eb298ee tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:50.209534 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-b5542bb3-60d0-4409-9007-a7586eb298ee tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:50.220967 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-b5542bb3-60d0-4409-9007-a7586eb298ee tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:50.222635 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-b5542bb3-60d0-4409-9007-a7586eb298ee tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:50.223787 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-b5542bb3-60d0-4409-9007-a7586eb298ee tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1285 microversion: 2.20 time: 0.164772 Nov 02 14:39:50.237685 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 29/55] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:39:50 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1285 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:39:50.316157 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-59f9c9e0-6ded-4b52-8188-38bc674c37ca tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:50.317821 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-59f9c9e0-6ded-4b52-8188-38bc674c37ca tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] [instance: 1ffa9152-f022-466a-ab9b-9977066503d0] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:50.337299 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-59f9c9e0-6ded-4b52-8188-38bc674c37ca tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:50.339588 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-59f9c9e0-6ded-4b52-8188-38bc674c37ca tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:50.341031 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-59f9c9e0-6ded-4b52-8188-38bc674c37ca tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:50.341943 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-59f9c9e0-6ded-4b52-8188-38bc674c37ca tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:50.344937 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-59f9c9e0-6ded-4b52-8188-38bc674c37ca tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:50.345785 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-59f9c9e0-6ded-4b52-8188-38bc674c37ca tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:50.633456 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-47646a90-0f13-469e-aee3-4dcd97086a4a tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:50.634377 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-47646a90-0f13-469e-aee3-4dcd97086a4a tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:50.640545 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-47646a90-0f13-469e-aee3-4dcd97086a4a tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:50.641386 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-47646a90-0f13-469e-aee3-4dcd97086a4a tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:50.642155 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-47646a90-0f13-469e-aee3-4dcd97086a4a tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:50.643181 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-47646a90-0f13-469e-aee3-4dcd97086a4a tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:50.643819 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-47646a90-0f13-469e-aee3-4dcd97086a4a tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:50.644666 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-47646a90-0f13-469e-aee3-4dcd97086a4a tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:50.649078 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-59f9c9e0-6ded-4b52-8188-38bc674c37ca tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8706e96002946b2b9bfe87de5c3271a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60403061fba42eba98a7c89987672a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:50.660166 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-59f9c9e0-6ded-4b52-8188-38bc674c37ca tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] 10.222.0.30 "GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0" status: 200 len: 1315 microversion: 2.1 time: 0.349334 Nov 02 14:39:50.661869 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 27/56] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:50 2022] GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0 => generated 1315 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:50.737772 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-47646a90-0f13-469e-aee3-4dcd97086a4a tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:50.747932 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-47646a90-0f13-469e-aee3-4dcd97086a4a tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1282 microversion: 2.1 time: 0.118662 Nov 02 14:39:50.748658 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 30/57] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:50 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1282 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:39:51.251594 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-6dc420db-2d0e-4217-9fc3-05c465e2cbec tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:51.252654 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-6dc420db-2d0e-4217-9fc3-05c465e2cbec tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:51.272413 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6dc420db-2d0e-4217-9fc3-05c465e2cbec tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:51.273363 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6dc420db-2d0e-4217-9fc3-05c465e2cbec tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:51.273816 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6dc420db-2d0e-4217-9fc3-05c465e2cbec tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:51.274536 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6dc420db-2d0e-4217-9fc3-05c465e2cbec tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:51.281966 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6dc420db-2d0e-4217-9fc3-05c465e2cbec tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:51.282548 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6dc420db-2d0e-4217-9fc3-05c465e2cbec tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:51.383404 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-6dc420db-2d0e-4217-9fc3-05c465e2cbec tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:51.385919 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell0:SELECT=4 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:39:51.393927 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-6dc420db-2d0e-4217-9fc3-05c465e2cbec tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:51.395773 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-6dc420db-2d0e-4217-9fc3-05c465e2cbec tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:51.397290 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-6dc420db-2d0e-4217-9fc3-05c465e2cbec tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1285 microversion: 2.20 time: 0.151290 Nov 02 14:39:51.409525 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 28/58] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:39:51 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1285 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:39:51.684290 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-e7234bac-f0d1-4e31-b11a-faf05bb9b64f tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:51.685704 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-e7234bac-f0d1-4e31-b11a-faf05bb9b64f tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] [instance: 1ffa9152-f022-466a-ab9b-9977066503d0] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:51.778743 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e7234bac-f0d1-4e31-b11a-faf05bb9b64f tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:51.778743 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e7234bac-f0d1-4e31-b11a-faf05bb9b64f tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:51.778743 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e7234bac-f0d1-4e31-b11a-faf05bb9b64f tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:51.778743 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e7234bac-f0d1-4e31-b11a-faf05bb9b64f tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:51.779124 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e7234bac-f0d1-4e31-b11a-faf05bb9b64f tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:51.779124 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e7234bac-f0d1-4e31-b11a-faf05bb9b64f tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:51.782537 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-51da2223-ca55-42ca-aee6-677e7ef7c0b0 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:51.783315 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-51da2223-ca55-42ca-aee6-677e7ef7c0b0 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:51.792293 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-51da2223-ca55-42ca-aee6-677e7ef7c0b0 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:51.793752 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-51da2223-ca55-42ca-aee6-677e7ef7c0b0 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:51.794553 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-51da2223-ca55-42ca-aee6-677e7ef7c0b0 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:51.795750 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-51da2223-ca55-42ca-aee6-677e7ef7c0b0 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:51.796670 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-51da2223-ca55-42ca-aee6-677e7ef7c0b0 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:51.797328 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-51da2223-ca55-42ca-aee6-677e7ef7c0b0 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:51.882844 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell0:SELECT=22 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:39:51.887529 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-51da2223-ca55-42ca-aee6-677e7ef7c0b0 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:51.897941 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-51da2223-ca55-42ca-aee6-677e7ef7c0b0 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1282 microversion: 2.1 time: 0.121944 Nov 02 14:39:51.898520 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 29/59] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:51 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1282 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:39:51.909277 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-e7234bac-f0d1-4e31-b11a-faf05bb9b64f tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8706e96002946b2b9bfe87de5c3271a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60403061fba42eba98a7c89987672a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:51.914732 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell1:SELECT=100 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:39:51.915570 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-e7234bac-f0d1-4e31-b11a-faf05bb9b64f tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] 10.222.0.30 "GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0" status: 200 len: 1315 microversion: 2.1 time: 0.235479 Nov 02 14:39:51.916145 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 31/60] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:51 2022] GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0 => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:52.424991 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-8cb1c491-215e-4258-a60f-a89d53011618 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:52.425579 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-8cb1c491-215e-4258-a60f-a89d53011618 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:52.431916 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8cb1c491-215e-4258-a60f-a89d53011618 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:52.432407 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8cb1c491-215e-4258-a60f-a89d53011618 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:52.432901 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8cb1c491-215e-4258-a60f-a89d53011618 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:52.433576 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8cb1c491-215e-4258-a60f-a89d53011618 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:52.434203 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8cb1c491-215e-4258-a60f-a89d53011618 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:52.434631 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8cb1c491-215e-4258-a60f-a89d53011618 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:52.501261 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-8cb1c491-215e-4258-a60f-a89d53011618 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:52.509753 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-8cb1c491-215e-4258-a60f-a89d53011618 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:52.511257 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-8cb1c491-215e-4258-a60f-a89d53011618 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:52.512367 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-8cb1c491-215e-4258-a60f-a89d53011618 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1285 microversion: 2.20 time: 0.092114 Nov 02 14:39:52.512926 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 30/61] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:39:52 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:39:52.922840 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-b15764ad-57c2-4a83-94ad-2ee00d0d7018 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:52.923445 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-b15764ad-57c2-4a83-94ad-2ee00d0d7018 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:52.930295 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b15764ad-57c2-4a83-94ad-2ee00d0d7018 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:52.930780 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b15764ad-57c2-4a83-94ad-2ee00d0d7018 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:52.931211 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b15764ad-57c2-4a83-94ad-2ee00d0d7018 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:52.931896 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b15764ad-57c2-4a83-94ad-2ee00d0d7018 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:52.932339 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b15764ad-57c2-4a83-94ad-2ee00d0d7018 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:52.932779 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b15764ad-57c2-4a83-94ad-2ee00d0d7018 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:52.940597 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-ec2ab2da-4f2a-4ae9-a4f7-fa80f4aa7a97 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:52.941409 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-ec2ab2da-4f2a-4ae9-a4f7-fa80f4aa7a97 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] [instance: 1ffa9152-f022-466a-ab9b-9977066503d0] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:52.960962 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ec2ab2da-4f2a-4ae9-a4f7-fa80f4aa7a97 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:52.961490 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ec2ab2da-4f2a-4ae9-a4f7-fa80f4aa7a97 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:52.961930 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ec2ab2da-4f2a-4ae9-a4f7-fa80f4aa7a97 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:52.962631 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ec2ab2da-4f2a-4ae9-a4f7-fa80f4aa7a97 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:52.963083 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ec2ab2da-4f2a-4ae9-a4f7-fa80f4aa7a97 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:52.963502 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ec2ab2da-4f2a-4ae9-a4f7-fa80f4aa7a97 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:53.069534 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-b15764ad-57c2-4a83-94ad-2ee00d0d7018 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:53.095186 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-b15764ad-57c2-4a83-94ad-2ee00d0d7018 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1282 microversion: 2.1 time: 0.176310 Nov 02 14:39:53.096690 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 32/62] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:52 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1282 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:53.179897 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-ec2ab2da-4f2a-4ae9-a4f7-fa80f4aa7a97 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8706e96002946b2b9bfe87de5c3271a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60403061fba42eba98a7c89987672a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:53.190886 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-ec2ab2da-4f2a-4ae9-a4f7-fa80f4aa7a97 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] 10.222.0.30 "GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0" status: 200 len: 1315 microversion: 2.1 time: 0.254830 Nov 02 14:39:53.194406 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 31/63] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:52 2022] GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0 => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:39:53.541273 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-82a2a5a0-6df7-46c7-b833-7217717e05b8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:53.541871 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-82a2a5a0-6df7-46c7-b833-7217717e05b8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:53.543778 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell0:SELECT=22 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:39:53.550559 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-82a2a5a0-6df7-46c7-b833-7217717e05b8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:53.551035 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-82a2a5a0-6df7-46c7-b833-7217717e05b8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:53.551655 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-82a2a5a0-6df7-46c7-b833-7217717e05b8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:53.563166 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-82a2a5a0-6df7-46c7-b833-7217717e05b8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:53.563166 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-82a2a5a0-6df7-46c7-b833-7217717e05b8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:53.563166 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-82a2a5a0-6df7-46c7-b833-7217717e05b8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:53.616180 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-82a2a5a0-6df7-46c7-b833-7217717e05b8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:53.624724 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-82a2a5a0-6df7-46c7-b833-7217717e05b8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:53.626289 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-82a2a5a0-6df7-46c7-b833-7217717e05b8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:53.627368 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-82a2a5a0-6df7-46c7-b833-7217717e05b8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1285 microversion: 2.20 time: 0.090109 Nov 02 14:39:53.627913 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 33/64] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:39:53 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:39:54.121258 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-284ead27-14fe-4f7f-ad83-d90a27251ad3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:54.122052 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-284ead27-14fe-4f7f-ad83-d90a27251ad3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:54.128845 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-284ead27-14fe-4f7f-ad83-d90a27251ad3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:54.129575 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-284ead27-14fe-4f7f-ad83-d90a27251ad3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:54.130170 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-284ead27-14fe-4f7f-ad83-d90a27251ad3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:54.131016 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-284ead27-14fe-4f7f-ad83-d90a27251ad3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:54.131625 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-284ead27-14fe-4f7f-ad83-d90a27251ad3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:54.132243 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-284ead27-14fe-4f7f-ad83-d90a27251ad3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:54.209263 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-284ead27-14fe-4f7f-ad83-d90a27251ad3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:54.212967 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell1:SELECT=100 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:39:54.217075 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-c349fe10-b0af-452e-a9b6-ee1c5ddaa579 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:54.220350 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-c349fe10-b0af-452e-a9b6-ee1c5ddaa579 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] [instance: 1ffa9152-f022-466a-ab9b-9977066503d0] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:54.229934 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c349fe10-b0af-452e-a9b6-ee1c5ddaa579 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:54.230189 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c349fe10-b0af-452e-a9b6-ee1c5ddaa579 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:54.231744 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c349fe10-b0af-452e-a9b6-ee1c5ddaa579 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:54.232566 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c349fe10-b0af-452e-a9b6-ee1c5ddaa579 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:54.233287 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-284ead27-14fe-4f7f-ad83-d90a27251ad3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1282 microversion: 2.1 time: 0.117834 Nov 02 14:39:54.233419 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c349fe10-b0af-452e-a9b6-ee1c5ddaa579 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:54.233766 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c349fe10-b0af-452e-a9b6-ee1c5ddaa579 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:54.233907 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 32/65] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:54 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1282 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:54.502337 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-c349fe10-b0af-452e-a9b6-ee1c5ddaa579 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8706e96002946b2b9bfe87de5c3271a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60403061fba42eba98a7c89987672a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:54.518323 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-c349fe10-b0af-452e-a9b6-ee1c5ddaa579 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] 10.222.0.30 "GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0" status: 200 len: 1315 microversion: 2.1 time: 0.306053 Nov 02 14:39:54.533444 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 34/66] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:54 2022] GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0 => generated 1315 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:54.654240 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-bb07f81c-f891-43d2-8c92-7de962948d0b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:54.656723 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-bb07f81c-f891-43d2-8c92-7de962948d0b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:54.674175 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-bb07f81c-f891-43d2-8c92-7de962948d0b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:54.675209 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-bb07f81c-f891-43d2-8c92-7de962948d0b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:54.678891 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-bb07f81c-f891-43d2-8c92-7de962948d0b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:54.681698 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-bb07f81c-f891-43d2-8c92-7de962948d0b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:54.683862 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-bb07f81c-f891-43d2-8c92-7de962948d0b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:54.684555 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-bb07f81c-f891-43d2-8c92-7de962948d0b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:54.796987 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-bb07f81c-f891-43d2-8c92-7de962948d0b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:54.806591 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-bb07f81c-f891-43d2-8c92-7de962948d0b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:54.814423 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-bb07f81c-f891-43d2-8c92-7de962948d0b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:54.821296 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-bb07f81c-f891-43d2-8c92-7de962948d0b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1277 microversion: 2.20 time: 0.167309 Nov 02 14:39:54.821296 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 33/67] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:39:54 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1277 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:39:55.260539 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-c83d0891-4dc0-4699-80c0-ea1d5f35aab0 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:55.261923 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-c83d0891-4dc0-4699-80c0-ea1d5f35aab0 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:55.270023 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c83d0891-4dc0-4699-80c0-ea1d5f35aab0 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:55.270634 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c83d0891-4dc0-4699-80c0-ea1d5f35aab0 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:55.271247 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c83d0891-4dc0-4699-80c0-ea1d5f35aab0 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:55.272047 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c83d0891-4dc0-4699-80c0-ea1d5f35aab0 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:55.272607 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c83d0891-4dc0-4699-80c0-ea1d5f35aab0 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:55.273378 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c83d0891-4dc0-4699-80c0-ea1d5f35aab0 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:55.515613 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-c83d0891-4dc0-4699-80c0-ea1d5f35aab0 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:55.527455 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-c83d0891-4dc0-4699-80c0-ea1d5f35aab0 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1322 microversion: 2.1 time: 0.272176 Nov 02 14:39:55.528044 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 35/68] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:55 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1322 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:55.563258 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-d7c32c2c-9448-4686-8170-6b0fbefb201b tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:55.564698 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-d7c32c2c-9448-4686-8170-6b0fbefb201b tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] [instance: 1ffa9152-f022-466a-ab9b-9977066503d0] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:55.574435 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d7c32c2c-9448-4686-8170-6b0fbefb201b tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:55.575096 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d7c32c2c-9448-4686-8170-6b0fbefb201b tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:55.575716 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d7c32c2c-9448-4686-8170-6b0fbefb201b tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:55.576784 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d7c32c2c-9448-4686-8170-6b0fbefb201b tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:55.577692 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d7c32c2c-9448-4686-8170-6b0fbefb201b tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:55.578801 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d7c32c2c-9448-4686-8170-6b0fbefb201b tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:55.771481 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-d7c32c2c-9448-4686-8170-6b0fbefb201b tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8706e96002946b2b9bfe87de5c3271a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60403061fba42eba98a7c89987672a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:55.820476 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-d7c32c2c-9448-4686-8170-6b0fbefb201b tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] 10.222.0.30 "GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0" status: 200 len: 1315 microversion: 2.1 time: 0.259068 Nov 02 14:39:55.835669 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 34/69] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:55 2022] GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0 => generated 1315 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:55.842913 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-01c25ef5-a87a-42d3-aa83-e4a7d285749d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:55.843833 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-01c25ef5-a87a-42d3-aa83-e4a7d285749d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:55.861036 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-01c25ef5-a87a-42d3-aa83-e4a7d285749d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:55.861697 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-01c25ef5-a87a-42d3-aa83-e4a7d285749d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:55.862149 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-01c25ef5-a87a-42d3-aa83-e4a7d285749d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:55.862885 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-01c25ef5-a87a-42d3-aa83-e4a7d285749d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:55.863375 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-01c25ef5-a87a-42d3-aa83-e4a7d285749d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:55.863785 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-01c25ef5-a87a-42d3-aa83-e4a7d285749d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:56.106065 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-01c25ef5-a87a-42d3-aa83-e4a7d285749d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:56.118374 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-01c25ef5-a87a-42d3-aa83-e4a7d285749d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:56.120562 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-01c25ef5-a87a-42d3-aa83-e4a7d285749d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:56.124855 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-01c25ef5-a87a-42d3-aa83-e4a7d285749d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1333 microversion: 2.20 time: 0.285934 Nov 02 14:39:56.136760 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 36/70] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:39:55 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1333 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:39:56.498297 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [req-aa8e5c51-3f75-41a9-af42-592eea9f0751 req-de59410d-e180-4afa-afd0-768c49e7c58d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ffa9152-f022-466a-ab9b-9977066503d0", "tag": "34a3ffa0-db81-40b1-8b9b-0d40f164bd30"}]} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:39:56.534702 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-aa8e5c51-3f75-41a9-af42-592eea9f0751 req-de59410d-e180-4afa-afd0-768c49e7c58d service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:56.536276 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-aa8e5c51-3f75-41a9-af42-592eea9f0751 req-de59410d-e180-4afa-afd0-768c49e7c58d service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:56.538055 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-aa8e5c51-3f75-41a9-af42-592eea9f0751 req-de59410d-e180-4afa-afd0-768c49e7c58d service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:56.565650 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-d8115262-8089-4e1b-8578-e720f9ec17cf tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:56.567031 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-d8115262-8089-4e1b-8578-e720f9ec17cf tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:56.570149 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:39:56.576322 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.compute.server_external_events [req-aa8e5c51-3f75-41a9-af42-592eea9f0751 req-de59410d-e180-4afa-afd0-768c49e7c58d service nova] Creating event network-changed:34a3ffa0-db81-40b1-8b9b-0d40f164bd30 for instance 1ffa9152-f022-466a-ab9b-9977066503d0 on hv-cinder-86236 Nov 02 14:39:56.578684 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-aa8e5c51-3f75-41a9-af42-592eea9f0751 req-de59410d-e180-4afa-afd0-768c49e7c58d service nova] Acquiring lock "compute-rpcapi-router" {{(pid=119658) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 14:39:56.579280 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-aa8e5c51-3f75-41a9-af42-592eea9f0751 req-de59410d-e180-4afa-afd0-768c49e7c58d service nova] Acquired lock "compute-rpcapi-router" {{(pid=119658) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 14:39:56.579569 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d8115262-8089-4e1b-8578-e720f9ec17cf tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:56.580068 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d8115262-8089-4e1b-8578-e720f9ec17cf tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:56.580510 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d8115262-8089-4e1b-8578-e720f9ec17cf tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:56.581227 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8ec3c4f7-6e44-474a-83d2-046a66f25075 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:56.581355 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d8115262-8089-4e1b-8578-e720f9ec17cf tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:56.581680 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d8115262-8089-4e1b-8578-e720f9ec17cf tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:56.582101 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d8115262-8089-4e1b-8578-e720f9ec17cf tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:56.582364 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8ec3c4f7-6e44-474a-83d2-046a66f25075 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:56.582970 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8ec3c4f7-6e44-474a-83d2-046a66f25075 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:56.583882 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8ec3c4f7-6e44-474a-83d2-046a66f25075 None None] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:56.584560 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8ec3c4f7-6e44-474a-83d2-046a66f25075 None None] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:56.585200 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8ec3c4f7-6e44-474a-83d2-046a66f25075 None None] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:56.624978 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.compute.rpcapi [None req-8ec3c4f7-6e44-474a-83d2-046a66f25075 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Nov 02 14:39:56.626164 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8ec3c4f7-6e44-474a-83d2-046a66f25075 None None] Releasing lock "compute-rpcapi-router" {{(pid=119658) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 14:39:56.653236 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-8ec3c4f7-6e44-474a-83d2-046a66f25075 None None] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.427607 Nov 02 14:39:56.655460 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 35/71] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:39:56.850022 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-298f52bd-c5c6-4d52-bc08-98d724d51dd2 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:56.851091 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-298f52bd-c5c6-4d52-bc08-98d724d51dd2 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] [instance: 1ffa9152-f022-466a-ab9b-9977066503d0] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:56.861691 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-298f52bd-c5c6-4d52-bc08-98d724d51dd2 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:56.862323 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-298f52bd-c5c6-4d52-bc08-98d724d51dd2 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:56.863014 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-298f52bd-c5c6-4d52-bc08-98d724d51dd2 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:56.863873 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-298f52bd-c5c6-4d52-bc08-98d724d51dd2 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:56.864419 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-298f52bd-c5c6-4d52-bc08-98d724d51dd2 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:56.865072 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-298f52bd-c5c6-4d52-bc08-98d724d51dd2 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:57.006998 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-d8115262-8089-4e1b-8578-e720f9ec17cf tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:57.016205 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-d8115262-8089-4e1b-8578-e720f9ec17cf tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1322 microversion: 2.1 time: 0.454489 Nov 02 14:39:57.017534 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 37/72] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:56 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1322 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:57.193575 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-6d69ecdf-da45-4695-aabd-89c89c33cc5a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:57.194298 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-6d69ecdf-da45-4695-aabd-89c89c33cc5a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:57.203786 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6d69ecdf-da45-4695-aabd-89c89c33cc5a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:57.203786 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6d69ecdf-da45-4695-aabd-89c89c33cc5a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:57.204203 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6d69ecdf-da45-4695-aabd-89c89c33cc5a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:57.205416 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6d69ecdf-da45-4695-aabd-89c89c33cc5a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:57.206080 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6d69ecdf-da45-4695-aabd-89c89c33cc5a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:57.206978 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6d69ecdf-da45-4695-aabd-89c89c33cc5a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:57.387166 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-6d69ecdf-da45-4695-aabd-89c89c33cc5a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:57.405801 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-6d69ecdf-da45-4695-aabd-89c89c33cc5a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:57.409279 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-6d69ecdf-da45-4695-aabd-89c89c33cc5a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:57.409439 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-298f52bd-c5c6-4d52-bc08-98d724d51dd2 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8706e96002946b2b9bfe87de5c3271a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60403061fba42eba98a7c89987672a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:57.414514 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-6d69ecdf-da45-4695-aabd-89c89c33cc5a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1339 microversion: 2.20 time: 0.230838 Nov 02 14:39:57.416160 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 38/73] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:39:57 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1339 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:39:57.431126 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-298f52bd-c5c6-4d52-bc08-98d724d51dd2 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] 10.222.0.30 "GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0" status: 200 len: 1315 microversion: 2.1 time: 0.586151 Nov 02 14:39:57.435414 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 36/74] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:56 2022] GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0 => generated 1315 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:39:57.595269 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [req-a1169759-d25c-4709-b548-72d2cac303b5 req-ecee8b23-2cfd-4548-bca6-fbf76cf11245 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "803e6b19-d962-4158-9a6c-e38cbd2b3e04", "tag": "b3d49dc7-6e55-4eda-a524-acbf2248d0e8"}]} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:39:57.613580 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-a1169759-d25c-4709-b548-72d2cac303b5 req-ecee8b23-2cfd-4548-bca6-fbf76cf11245 service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:57.614534 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-a1169759-d25c-4709-b548-72d2cac303b5 req-ecee8b23-2cfd-4548-bca6-fbf76cf11245 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:57.615333 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-a1169759-d25c-4709-b548-72d2cac303b5 req-ecee8b23-2cfd-4548-bca6-fbf76cf11245 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:57.641046 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.compute.server_external_events [req-a1169759-d25c-4709-b548-72d2cac303b5 req-ecee8b23-2cfd-4548-bca6-fbf76cf11245 service nova] Creating event network-changed:b3d49dc7-6e55-4eda-a524-acbf2248d0e8 for instance 803e6b19-d962-4158-9a6c-e38cbd2b3e04 on hv-cinder-86236 Nov 02 14:39:57.643623 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-a1169759-d25c-4709-b548-72d2cac303b5 req-ecee8b23-2cfd-4548-bca6-fbf76cf11245 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=119659) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 14:39:57.643623 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-a1169759-d25c-4709-b548-72d2cac303b5 req-ecee8b23-2cfd-4548-bca6-fbf76cf11245 service nova] Acquired lock "compute-rpcapi-router" {{(pid=119659) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 14:39:57.643623 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-460a5e1a-bd0d-4f36-911a-3278252a894b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:57.644430 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-460a5e1a-bd0d-4f36-911a-3278252a894b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:57.645088 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-460a5e1a-bd0d-4f36-911a-3278252a894b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:57.646059 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-460a5e1a-bd0d-4f36-911a-3278252a894b None None] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:57.646598 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-460a5e1a-bd0d-4f36-911a-3278252a894b None None] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:57.647091 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-460a5e1a-bd0d-4f36-911a-3278252a894b None None] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:57.658729 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.compute.rpcapi [None req-460a5e1a-bd0d-4f36-911a-3278252a894b None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Nov 02 14:39:57.659739 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-460a5e1a-bd0d-4f36-911a-3278252a894b None None] Releasing lock "compute-rpcapi-router" {{(pid=119659) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 14:39:57.676828 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-460a5e1a-bd0d-4f36-911a-3278252a894b None None] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.258817 Nov 02 14:39:57.677918 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 39/75] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:39:58.040262 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-6b9fafd0-5dc3-4fd3-8c36-03f2634b3ba6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:58.040888 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-6b9fafd0-5dc3-4fd3-8c36-03f2634b3ba6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:58.044825 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:39:58.051075 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6b9fafd0-5dc3-4fd3-8c36-03f2634b3ba6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:58.051643 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6b9fafd0-5dc3-4fd3-8c36-03f2634b3ba6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:58.052090 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6b9fafd0-5dc3-4fd3-8c36-03f2634b3ba6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:58.057409 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6b9fafd0-5dc3-4fd3-8c36-03f2634b3ba6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:58.057409 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6b9fafd0-5dc3-4fd3-8c36-03f2634b3ba6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:58.057409 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6b9fafd0-5dc3-4fd3-8c36-03f2634b3ba6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:58.433513 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-6b9fafd0-5dc3-4fd3-8c36-03f2634b3ba6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:58.439050 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-6b9fafd0-5dc3-4fd3-8c36-03f2634b3ba6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1322 microversion: 2.1 time: 0.402872 Nov 02 14:39:58.439616 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 37/76] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:58 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1322 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:58.456273 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-1ad4be70-b958-4ce5-a843-74d49d428c48 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:58.457174 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-1ad4be70-b958-4ce5-a843-74d49d428c48 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:58.476105 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-2bfac7c0-c997-4179-92ba-01880fd6fc83 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:58.476733 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-2bfac7c0-c997-4179-92ba-01880fd6fc83 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] [instance: 1ffa9152-f022-466a-ab9b-9977066503d0] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:58.486843 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1ad4be70-b958-4ce5-a843-74d49d428c48 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:58.487334 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1ad4be70-b958-4ce5-a843-74d49d428c48 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:58.492754 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1ad4be70-b958-4ce5-a843-74d49d428c48 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:58.494930 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1ad4be70-b958-4ce5-a843-74d49d428c48 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:58.495419 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1ad4be70-b958-4ce5-a843-74d49d428c48 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:58.495856 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1ad4be70-b958-4ce5-a843-74d49d428c48 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:58.498375 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2bfac7c0-c997-4179-92ba-01880fd6fc83 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:58.500922 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2bfac7c0-c997-4179-92ba-01880fd6fc83 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:58.502870 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2bfac7c0-c997-4179-92ba-01880fd6fc83 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:58.505197 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2bfac7c0-c997-4179-92ba-01880fd6fc83 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:58.505776 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2bfac7c0-c997-4179-92ba-01880fd6fc83 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:58.506920 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2bfac7c0-c997-4179-92ba-01880fd6fc83 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:58.649569 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-1ad4be70-b958-4ce5-a843-74d49d428c48 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:58.661717 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-1ad4be70-b958-4ce5-a843-74d49d428c48 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:58.671398 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-1ad4be70-b958-4ce5-a843-74d49d428c48 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:58.672923 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-1ad4be70-b958-4ce5-a843-74d49d428c48 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1339 microversion: 2.20 time: 0.224792 Nov 02 14:39:58.675518 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 40/77] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:39:58 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1339 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:39:58.809491 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-2bfac7c0-c997-4179-92ba-01880fd6fc83 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8706e96002946b2b9bfe87de5c3271a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60403061fba42eba98a7c89987672a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:58.823994 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-2bfac7c0-c997-4179-92ba-01880fd6fc83 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] 10.222.0.30 "GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0" status: 200 len: 1315 microversion: 2.1 time: 0.362472 Nov 02 14:39:58.842400 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 38/78] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:58 2022] GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0 => generated 1315 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:59.468054 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-75974d43-19ea-48fe-a495-b7668c1b6290 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:59.468893 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-75974d43-19ea-48fe-a495-b7668c1b6290 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:59.475176 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-75974d43-19ea-48fe-a495-b7668c1b6290 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:59.475625 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-75974d43-19ea-48fe-a495-b7668c1b6290 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:59.476061 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-75974d43-19ea-48fe-a495-b7668c1b6290 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:59.476791 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-75974d43-19ea-48fe-a495-b7668c1b6290 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:59.477331 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-75974d43-19ea-48fe-a495-b7668c1b6290 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:59.478004 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-75974d43-19ea-48fe-a495-b7668c1b6290 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:59.627498 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-75974d43-19ea-48fe-a495-b7668c1b6290 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:59.635738 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-75974d43-19ea-48fe-a495-b7668c1b6290 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1322 microversion: 2.1 time: 0.171952 Nov 02 14:39:59.636331 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 41/79] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:59 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:59.692623 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [req-fd7c17c7-b2e3-4234-923e-cb9d7a16621d req-d8b24bc9-ea95-4277-91bd-ec643411459c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1620aab-e26a-482d-9816-6fa784243fc9", "tag": "c0906b93-2520-43fe-8940-decdff05858b"}]} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:39:59.703525 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-fd7c17c7-b2e3-4234-923e-cb9d7a16621d req-d8b24bc9-ea95-4277-91bd-ec643411459c service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:59.703985 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-b8832d01-ab50-458c-a5b1-d0662ea71ecd tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:59.704567 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-fd7c17c7-b2e3-4234-923e-cb9d7a16621d req-d8b24bc9-ea95-4277-91bd-ec643411459c service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:59.704567 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-fd7c17c7-b2e3-4234-923e-cb9d7a16621d req-d8b24bc9-ea95-4277-91bd-ec643411459c service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:59.704718 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-b8832d01-ab50-458c-a5b1-d0662ea71ecd tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:59.711009 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b8832d01-ab50-458c-a5b1-d0662ea71ecd tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:59.711469 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b8832d01-ab50-458c-a5b1-d0662ea71ecd tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:59.711905 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b8832d01-ab50-458c-a5b1-d0662ea71ecd tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:59.712892 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b8832d01-ab50-458c-a5b1-d0662ea71ecd tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:59.713158 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b8832d01-ab50-458c-a5b1-d0662ea71ecd tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:59.713530 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b8832d01-ab50-458c-a5b1-d0662ea71ecd tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:59.715964 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.compute.server_external_events [req-fd7c17c7-b2e3-4234-923e-cb9d7a16621d req-d8b24bc9-ea95-4277-91bd-ec643411459c service nova] Creating event network-changed:c0906b93-2520-43fe-8940-decdff05858b for instance d1620aab-e26a-482d-9816-6fa784243fc9 on hv-cinder-86236 Nov 02 14:39:59.721518 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [req-fd7c17c7-b2e3-4234-923e-cb9d7a16621d req-d8b24bc9-ea95-4277-91bd-ec643411459c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032538 Nov 02 14:39:59.722183 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 39/80] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:39:59.849149 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-d001dd71-9204-4d1a-9565-0aa9f073bbc4 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:59.849848 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-d001dd71-9204-4d1a-9565-0aa9f073bbc4 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] [instance: 1ffa9152-f022-466a-ab9b-9977066503d0] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:59.856307 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d001dd71-9204-4d1a-9565-0aa9f073bbc4 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:59.856833 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d001dd71-9204-4d1a-9565-0aa9f073bbc4 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:59.857260 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d001dd71-9204-4d1a-9565-0aa9f073bbc4 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:59.858283 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d001dd71-9204-4d1a-9565-0aa9f073bbc4 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:59.859011 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d001dd71-9204-4d1a-9565-0aa9f073bbc4 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:59.859586 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d001dd71-9204-4d1a-9565-0aa9f073bbc4 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:59.865502 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-b8832d01-ab50-458c-a5b1-d0662ea71ecd tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:59.873089 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-b8832d01-ab50-458c-a5b1-d0662ea71ecd tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:59.875616 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-b8832d01-ab50-458c-a5b1-d0662ea71ecd tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:59.876746 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-b8832d01-ab50-458c-a5b1-d0662ea71ecd tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1407 microversion: 2.20 time: 0.177710 Nov 02 14:39:59.877554 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 42/81] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:39:59 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:40:00.012057 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-d001dd71-9204-4d1a-9565-0aa9f073bbc4 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8706e96002946b2b9bfe87de5c3271a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60403061fba42eba98a7c89987672a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:00.020896 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-d001dd71-9204-4d1a-9565-0aa9f073bbc4 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] 10.222.0.30 "GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0" status: 200 len: 1315 microversion: 2.1 time: 0.175913 Nov 02 14:40:00.025549 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 40/82] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:59 2022] GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:40:00.661025 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-144abc92-ea32-48ee-b069-a9cb481f35a3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:00.662091 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-144abc92-ea32-48ee-b069-a9cb481f35a3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:00.668433 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-144abc92-ea32-48ee-b069-a9cb481f35a3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:00.668923 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-144abc92-ea32-48ee-b069-a9cb481f35a3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:00.669783 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-144abc92-ea32-48ee-b069-a9cb481f35a3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:00.670812 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-144abc92-ea32-48ee-b069-a9cb481f35a3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:00.671748 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-144abc92-ea32-48ee-b069-a9cb481f35a3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:00.672263 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-144abc92-ea32-48ee-b069-a9cb481f35a3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:00.903158 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-0e8b61c5-6aeb-4f76-9d69-3c9288adccfc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:00.904438 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-0e8b61c5-6aeb-4f76-9d69-3c9288adccfc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:00.912585 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0e8b61c5-6aeb-4f76-9d69-3c9288adccfc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:00.913125 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0e8b61c5-6aeb-4f76-9d69-3c9288adccfc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:00.913571 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0e8b61c5-6aeb-4f76-9d69-3c9288adccfc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:00.914306 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0e8b61c5-6aeb-4f76-9d69-3c9288adccfc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:00.914758 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0e8b61c5-6aeb-4f76-9d69-3c9288adccfc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:00.915177 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0e8b61c5-6aeb-4f76-9d69-3c9288adccfc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:01.105225 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-144abc92-ea32-48ee-b069-a9cb481f35a3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:01.130014 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-144abc92-ea32-48ee-b069-a9cb481f35a3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1322 microversion: 2.1 time: 0.470898 Nov 02 14:40:01.134837 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 43/83] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:00 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1322 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:01.145834 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-fb959de1-b70f-4f6e-85a7-510de84948fe tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:01.153587 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-fb959de1-b70f-4f6e-85a7-510de84948fe tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] [instance: 1ffa9152-f022-466a-ab9b-9977066503d0] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:01.165399 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fb959de1-b70f-4f6e-85a7-510de84948fe tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:01.165980 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fb959de1-b70f-4f6e-85a7-510de84948fe tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:01.166397 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fb959de1-b70f-4f6e-85a7-510de84948fe tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:01.167194 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fb959de1-b70f-4f6e-85a7-510de84948fe tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:01.167825 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fb959de1-b70f-4f6e-85a7-510de84948fe tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:01.168299 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fb959de1-b70f-4f6e-85a7-510de84948fe tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:01.372368 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-0e8b61c5-6aeb-4f76-9d69-3c9288adccfc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:01.407365 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-0e8b61c5-6aeb-4f76-9d69-3c9288adccfc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:01.418212 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-0e8b61c5-6aeb-4f76-9d69-3c9288adccfc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:01.419591 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-0e8b61c5-6aeb-4f76-9d69-3c9288adccfc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1407 microversion: 2.20 time: 0.520871 Nov 02 14:40:01.433392 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 41/84] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:40:00 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1407 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:40:01.539549 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-fb959de1-b70f-4f6e-85a7-510de84948fe tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8706e96002946b2b9bfe87de5c3271a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60403061fba42eba98a7c89987672a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:01.552376 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-fb959de1-b70f-4f6e-85a7-510de84948fe tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] 10.222.0.30 "GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0" status: 200 len: 1315 microversion: 2.1 time: 0.415816 Nov 02 14:40:01.552848 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 44/85] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:01 2022] GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0 => generated 1315 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:02.014650 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [req-39eb6d68-18ce-48dc-8f4c-ba4bc620dd94 req-a8cb9691-d84d-4995-927e-39dff136090e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d0f8129-8155-4b7c-a462-f9c067ecfbca", "tag": "af3cc54b-a081-4f0c-aad1-a5c16e7530c7"}]} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:40:02.040474 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-39eb6d68-18ce-48dc-8f4c-ba4bc620dd94 req-a8cb9691-d84d-4995-927e-39dff136090e service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:02.041463 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-39eb6d68-18ce-48dc-8f4c-ba4bc620dd94 req-a8cb9691-d84d-4995-927e-39dff136090e service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:02.042131 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-39eb6d68-18ce-48dc-8f4c-ba4bc620dd94 req-a8cb9691-d84d-4995-927e-39dff136090e service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:02.062618 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.compute.server_external_events [req-39eb6d68-18ce-48dc-8f4c-ba4bc620dd94 req-a8cb9691-d84d-4995-927e-39dff136090e service nova] Creating event network-changed:af3cc54b-a081-4f0c-aad1-a5c16e7530c7 for instance 5d0f8129-8155-4b7c-a462-f9c067ecfbca on hv-cinder-86236 Nov 02 14:40:02.070188 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [req-39eb6d68-18ce-48dc-8f4c-ba4bc620dd94 req-a8cb9691-d84d-4995-927e-39dff136090e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063808 Nov 02 14:40:02.071379 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 42/86] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:40:02.155322 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-35794046-1257-40f9-bec1-6c2f0844226b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:02.156729 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-35794046-1257-40f9-bec1-6c2f0844226b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:02.163487 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-35794046-1257-40f9-bec1-6c2f0844226b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:02.173239 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-35794046-1257-40f9-bec1-6c2f0844226b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:02.173239 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-35794046-1257-40f9-bec1-6c2f0844226b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:02.173239 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-35794046-1257-40f9-bec1-6c2f0844226b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:02.173239 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-35794046-1257-40f9-bec1-6c2f0844226b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:02.173615 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-35794046-1257-40f9-bec1-6c2f0844226b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:02.462661 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-6fe2af4f-f5bb-4824-9b36-b5ff0411eca1 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:02.463775 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-6fe2af4f-f5bb-4824-9b36-b5ff0411eca1 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:02.472049 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6fe2af4f-f5bb-4824-9b36-b5ff0411eca1 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:02.472824 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6fe2af4f-f5bb-4824-9b36-b5ff0411eca1 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:02.473305 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6fe2af4f-f5bb-4824-9b36-b5ff0411eca1 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:02.474200 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6fe2af4f-f5bb-4824-9b36-b5ff0411eca1 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:02.475419 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6fe2af4f-f5bb-4824-9b36-b5ff0411eca1 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:02.476780 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6fe2af4f-f5bb-4824-9b36-b5ff0411eca1 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:02.938289 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-35794046-1257-40f9-bec1-6c2f0844226b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:02.950403 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-35794046-1257-40f9-bec1-6c2f0844226b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1322 microversion: 2.1 time: 0.798234 Nov 02 14:40:02.965402 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 45/87] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:02 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1322 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:02.974116 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-6fe2af4f-f5bb-4824-9b36-b5ff0411eca1 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:02.974507 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-37e2ab51-474e-4d65-b7e7-99d943efa6d7 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:02.975573 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-37e2ab51-474e-4d65-b7e7-99d943efa6d7 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] [instance: 1ffa9152-f022-466a-ab9b-9977066503d0] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:02.982435 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-37e2ab51-474e-4d65-b7e7-99d943efa6d7 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:02.983030 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-37e2ab51-474e-4d65-b7e7-99d943efa6d7 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:02.983752 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-37e2ab51-474e-4d65-b7e7-99d943efa6d7 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:02.984755 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-37e2ab51-474e-4d65-b7e7-99d943efa6d7 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:02.985231 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-37e2ab51-474e-4d65-b7e7-99d943efa6d7 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:02.989234 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-37e2ab51-474e-4d65-b7e7-99d943efa6d7 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:02.989362 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-6fe2af4f-f5bb-4824-9b36-b5ff0411eca1 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:02.992321 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-6fe2af4f-f5bb-4824-9b36-b5ff0411eca1 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:02.993734 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-6fe2af4f-f5bb-4824-9b36-b5ff0411eca1 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1407 microversion: 2.20 time: 0.535898 Nov 02 14:40:03.001645 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 43/88] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:40:02 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1407 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:40:03.219023 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-37e2ab51-474e-4d65-b7e7-99d943efa6d7 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8706e96002946b2b9bfe87de5c3271a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60403061fba42eba98a7c89987672a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:03.255470 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-37e2ab51-474e-4d65-b7e7-99d943efa6d7 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] 10.222.0.30 "GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0" status: 200 len: 1315 microversion: 2.1 time: 0.288480 Nov 02 14:40:03.274595 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 46/89] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:02 2022] GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0 => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:03.980304 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-88bfe9b9-333f-46da-a2e9-220e47b6cd3c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:03.982008 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-88bfe9b9-333f-46da-a2e9-220e47b6cd3c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:03.994001 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-88bfe9b9-333f-46da-a2e9-220e47b6cd3c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:04.000632 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-88bfe9b9-333f-46da-a2e9-220e47b6cd3c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:04.003231 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-88bfe9b9-333f-46da-a2e9-220e47b6cd3c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:04.004255 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-88bfe9b9-333f-46da-a2e9-220e47b6cd3c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:04.005648 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-88bfe9b9-333f-46da-a2e9-220e47b6cd3c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:04.006749 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-88bfe9b9-333f-46da-a2e9-220e47b6cd3c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:04.173283 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-88bfe9b9-333f-46da-a2e9-220e47b6cd3c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:04.188944 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-88bfe9b9-333f-46da-a2e9-220e47b6cd3c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1322 microversion: 2.1 time: 0.214004 Nov 02 14:40:04.189912 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 47/90] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:03 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:04.195914 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-fd8733a0-25f4-4d9e-9881-3b9cf980e3ad tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:04.196800 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-fd8733a0-25f4-4d9e-9881-3b9cf980e3ad tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:04.204799 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fd8733a0-25f4-4d9e-9881-3b9cf980e3ad tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:04.205769 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fd8733a0-25f4-4d9e-9881-3b9cf980e3ad tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:04.206377 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fd8733a0-25f4-4d9e-9881-3b9cf980e3ad tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:04.207436 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fd8733a0-25f4-4d9e-9881-3b9cf980e3ad tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:04.207910 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fd8733a0-25f4-4d9e-9881-3b9cf980e3ad tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:04.208340 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fd8733a0-25f4-4d9e-9881-3b9cf980e3ad tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:04.276804 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [req-9e74435f-1865-428e-9578-64de84b30887 req-f0069b9d-417e-422b-8bbf-57f7ee2ed000 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ffa9152-f022-466a-ab9b-9977066503d0", "name": "network-vif-plugged", "status": "completed", "tag": "34a3ffa0-db81-40b1-8b9b-0d40f164bd30"}]} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:40:04.292063 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-9e74435f-1865-428e-9578-64de84b30887 req-f0069b9d-417e-422b-8bbf-57f7ee2ed000 service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:04.292063 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-9e74435f-1865-428e-9578-64de84b30887 req-f0069b9d-417e-422b-8bbf-57f7ee2ed000 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:04.292063 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-9e74435f-1865-428e-9578-64de84b30887 req-f0069b9d-417e-422b-8bbf-57f7ee2ed000 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:04.308281 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.compute.server_external_events [req-9e74435f-1865-428e-9578-64de84b30887 req-f0069b9d-417e-422b-8bbf-57f7ee2ed000 service nova] Creating event network-vif-plugged:34a3ffa0-db81-40b1-8b9b-0d40f164bd30 for instance 1ffa9152-f022-466a-ab9b-9977066503d0 on hv-cinder-86236 Nov 02 14:40:04.314286 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [req-9e74435f-1865-428e-9578-64de84b30887 req-f0069b9d-417e-422b-8bbf-57f7ee2ed000 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.360524 Nov 02 14:40:04.315547 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 44/91] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:40:04.322385 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-ba041c94-fee4-4223-bcb6-1408d608f5bf tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:04.323086 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-ba041c94-fee4-4223-bcb6-1408d608f5bf tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] [instance: 1ffa9152-f022-466a-ab9b-9977066503d0] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:04.330108 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ba041c94-fee4-4223-bcb6-1408d608f5bf tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:04.330707 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ba041c94-fee4-4223-bcb6-1408d608f5bf tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:04.331148 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ba041c94-fee4-4223-bcb6-1408d608f5bf tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:04.331843 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ba041c94-fee4-4223-bcb6-1408d608f5bf tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:04.332360 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ba041c94-fee4-4223-bcb6-1408d608f5bf tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:04.332782 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ba041c94-fee4-4223-bcb6-1408d608f5bf tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:04.360728 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-fd8733a0-25f4-4d9e-9881-3b9cf980e3ad tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:04.364266 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell1:SELECT=100 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:40:04.369367 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-fd8733a0-25f4-4d9e-9881-3b9cf980e3ad tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:04.372114 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-fd8733a0-25f4-4d9e-9881-3b9cf980e3ad tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:04.372114 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-fd8733a0-25f4-4d9e-9881-3b9cf980e3ad tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1407 microversion: 2.20 time: 0.180989 Nov 02 14:40:04.377084 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 48/92] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:40:04 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:40:04.509174 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-ba041c94-fee4-4223-bcb6-1408d608f5bf tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8706e96002946b2b9bfe87de5c3271a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60403061fba42eba98a7c89987672a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:04.519110 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-ba041c94-fee4-4223-bcb6-1408d608f5bf tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] 10.222.0.30 "GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0" status: 200 len: 1315 microversion: 2.1 time: 0.201497 Nov 02 14:40:04.523045 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 45/93] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:04 2022] GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0 => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:05.213954 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-cc32274c-f6a7-412b-9e6b-e86d308cf46b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:05.214790 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-cc32274c-f6a7-412b-9e6b-e86d308cf46b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:05.221975 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-cc32274c-f6a7-412b-9e6b-e86d308cf46b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:05.222353 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-cc32274c-f6a7-412b-9e6b-e86d308cf46b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:05.223027 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-cc32274c-f6a7-412b-9e6b-e86d308cf46b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:05.223946 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-cc32274c-f6a7-412b-9e6b-e86d308cf46b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:05.224598 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-cc32274c-f6a7-412b-9e6b-e86d308cf46b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:05.225286 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-cc32274c-f6a7-412b-9e6b-e86d308cf46b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:05.399182 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-99bbf6be-0988-4501-ab24-3fdb64d261ec tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:05.400561 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-99bbf6be-0988-4501-ab24-3fdb64d261ec tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:05.410873 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-99bbf6be-0988-4501-ab24-3fdb64d261ec tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:05.412367 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-99bbf6be-0988-4501-ab24-3fdb64d261ec tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:05.415059 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-99bbf6be-0988-4501-ab24-3fdb64d261ec tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:05.416042 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-99bbf6be-0988-4501-ab24-3fdb64d261ec tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:05.419172 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-99bbf6be-0988-4501-ab24-3fdb64d261ec tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:05.419854 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-99bbf6be-0988-4501-ab24-3fdb64d261ec tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:05.462043 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-cc32274c-f6a7-412b-9e6b-e86d308cf46b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:05.472307 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-cc32274c-f6a7-412b-9e6b-e86d308cf46b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1322 microversion: 2.1 time: 0.262044 Nov 02 14:40:05.473624 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 49/94] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:05 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1322 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:05.548182 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-fbd7c330-1cd3-4bff-a3cf-f9e628447b21 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:05.549087 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-fbd7c330-1cd3-4bff-a3cf-f9e628447b21 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] [instance: 1ffa9152-f022-466a-ab9b-9977066503d0] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:05.563837 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fbd7c330-1cd3-4bff-a3cf-f9e628447b21 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:05.564956 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fbd7c330-1cd3-4bff-a3cf-f9e628447b21 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:05.566081 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fbd7c330-1cd3-4bff-a3cf-f9e628447b21 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:05.569231 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fbd7c330-1cd3-4bff-a3cf-f9e628447b21 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:05.572846 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fbd7c330-1cd3-4bff-a3cf-f9e628447b21 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:05.573337 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fbd7c330-1cd3-4bff-a3cf-f9e628447b21 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:05.707353 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-99bbf6be-0988-4501-ab24-3fdb64d261ec tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:05.719313 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-99bbf6be-0988-4501-ab24-3fdb64d261ec tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:05.721269 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-99bbf6be-0988-4501-ab24-3fdb64d261ec tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:05.722950 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-99bbf6be-0988-4501-ab24-3fdb64d261ec tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1407 microversion: 2.20 time: 0.328183 Nov 02 14:40:05.723781 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 46/95] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:40:05 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1407 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:40:05.835948 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-fbd7c330-1cd3-4bff-a3cf-f9e628447b21 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8706e96002946b2b9bfe87de5c3271a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60403061fba42eba98a7c89987672a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:05.854932 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-fbd7c330-1cd3-4bff-a3cf-f9e628447b21 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] 10.222.0.30 "GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0" status: 200 len: 1315 microversion: 2.1 time: 0.312560 Nov 02 14:40:05.855391 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 50/96] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:05 2022] GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0 => generated 1315 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:40:06.331745 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [req-66331697-8ec9-4744-a735-ed83b509902b req-e855b01f-a379-4bb2-9395-ce0f4ba7bdbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "803e6b19-d962-4158-9a6c-e38cbd2b3e04", "name": "network-vif-plugged", "status": "completed", "tag": "b3d49dc7-6e55-4eda-a524-acbf2248d0e8"}]} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:40:06.342790 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-66331697-8ec9-4744-a735-ed83b509902b req-e855b01f-a379-4bb2-9395-ce0f4ba7bdbb service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:06.343276 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-66331697-8ec9-4744-a735-ed83b509902b req-e855b01f-a379-4bb2-9395-ce0f4ba7bdbb service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:06.343711 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-66331697-8ec9-4744-a735-ed83b509902b req-e855b01f-a379-4bb2-9395-ce0f4ba7bdbb service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:06.356302 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.compute.server_external_events [req-66331697-8ec9-4744-a735-ed83b509902b req-e855b01f-a379-4bb2-9395-ce0f4ba7bdbb service nova] Creating event network-vif-plugged:b3d49dc7-6e55-4eda-a524-acbf2248d0e8 for instance 803e6b19-d962-4158-9a6c-e38cbd2b3e04 on hv-cinder-86236 Nov 02 14:40:06.365333 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [req-66331697-8ec9-4744-a735-ed83b509902b req-e855b01f-a379-4bb2-9395-ce0f4ba7bdbb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035894 Nov 02 14:40:06.366398 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 47/97] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:40:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:40:06.499263 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-e9a91d4c-82d8-4642-85ea-de093d4281d9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:06.508111 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-e9a91d4c-82d8-4642-85ea-de093d4281d9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:06.510753 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e9a91d4c-82d8-4642-85ea-de093d4281d9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:06.511620 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e9a91d4c-82d8-4642-85ea-de093d4281d9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:06.512513 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e9a91d4c-82d8-4642-85ea-de093d4281d9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:06.513654 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e9a91d4c-82d8-4642-85ea-de093d4281d9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:06.515303 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e9a91d4c-82d8-4642-85ea-de093d4281d9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:06.515749 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e9a91d4c-82d8-4642-85ea-de093d4281d9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:06.694333 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-e9a91d4c-82d8-4642-85ea-de093d4281d9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:06.703087 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-e9a91d4c-82d8-4642-85ea-de093d4281d9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1322 microversion: 2.1 time: 0.208267 Nov 02 14:40:06.703687 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 51/98] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:06 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:06.746759 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell0:SELECT=2 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:40:06.752246 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-958474f4-3e00-4997-8e6a-48259aea3b86 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:06.752949 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-958474f4-3e00-4997-8e6a-48259aea3b86 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:06.759362 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-958474f4-3e00-4997-8e6a-48259aea3b86 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:06.759835 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-958474f4-3e00-4997-8e6a-48259aea3b86 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:06.760296 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-958474f4-3e00-4997-8e6a-48259aea3b86 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:06.761185 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-958474f4-3e00-4997-8e6a-48259aea3b86 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:06.761638 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-958474f4-3e00-4997-8e6a-48259aea3b86 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:06.762048 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-958474f4-3e00-4997-8e6a-48259aea3b86 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:06.880231 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-6acccd34-8b0b-4f33-906d-8193e921c1d5 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:06.881253 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-6acccd34-8b0b-4f33-906d-8193e921c1d5 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] [instance: 1ffa9152-f022-466a-ab9b-9977066503d0] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:06.923081 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6acccd34-8b0b-4f33-906d-8193e921c1d5 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:06.924221 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6acccd34-8b0b-4f33-906d-8193e921c1d5 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:06.924834 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6acccd34-8b0b-4f33-906d-8193e921c1d5 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:06.927124 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6acccd34-8b0b-4f33-906d-8193e921c1d5 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:06.928566 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6acccd34-8b0b-4f33-906d-8193e921c1d5 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:06.929515 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6acccd34-8b0b-4f33-906d-8193e921c1d5 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:06.935025 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-958474f4-3e00-4997-8e6a-48259aea3b86 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:06.946786 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-958474f4-3e00-4997-8e6a-48259aea3b86 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:06.948460 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-958474f4-3e00-4997-8e6a-48259aea3b86 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:06.949739 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-958474f4-3e00-4997-8e6a-48259aea3b86 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1407 microversion: 2.20 time: 0.203902 Nov 02 14:40:06.950391 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 48/99] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:40:06 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1407 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:40:07.092005 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-6acccd34-8b0b-4f33-906d-8193e921c1d5 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8706e96002946b2b9bfe87de5c3271a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60403061fba42eba98a7c89987672a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:07.117143 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-6acccd34-8b0b-4f33-906d-8193e921c1d5 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] 10.222.0.30 "GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0" status: 200 len: 1315 microversion: 2.1 time: 0.241886 Nov 02 14:40:07.117916 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 52/100] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:06 2022] GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0 => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:40:07.727123 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-3bc81de6-b97b-4731-85d0-92d4906eab97 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:07.732462 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-3bc81de6-b97b-4731-85d0-92d4906eab97 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:07.735964 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3bc81de6-b97b-4731-85d0-92d4906eab97 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:07.736462 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3bc81de6-b97b-4731-85d0-92d4906eab97 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:07.737107 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3bc81de6-b97b-4731-85d0-92d4906eab97 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:07.737851 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3bc81de6-b97b-4731-85d0-92d4906eab97 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:07.739744 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3bc81de6-b97b-4731-85d0-92d4906eab97 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:07.740334 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3bc81de6-b97b-4731-85d0-92d4906eab97 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:07.916325 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-3bc81de6-b97b-4731-85d0-92d4906eab97 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:07.927154 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-3bc81de6-b97b-4731-85d0-92d4906eab97 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1322 microversion: 2.1 time: 0.203879 Nov 02 14:40:07.927910 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 49/101] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:07 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1322 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:07.988989 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-8c653938-a691-48c7-b64e-027ca876c6a0 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:07.996430 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-8c653938-a691-48c7-b64e-027ca876c6a0 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:08.007447 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell0:SELECT=2 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:40:08.012657 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8c653938-a691-48c7-b64e-027ca876c6a0 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:08.014729 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8c653938-a691-48c7-b64e-027ca876c6a0 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:08.015258 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8c653938-a691-48c7-b64e-027ca876c6a0 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:08.017126 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8c653938-a691-48c7-b64e-027ca876c6a0 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:08.017605 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8c653938-a691-48c7-b64e-027ca876c6a0 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:08.018036 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8c653938-a691-48c7-b64e-027ca876c6a0 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:08.171368 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-81b25710-7738-4719-9216-e4709d483889 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:08.172410 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-81b25710-7738-4719-9216-e4709d483889 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] [instance: 1ffa9152-f022-466a-ab9b-9977066503d0] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:08.178818 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-81b25710-7738-4719-9216-e4709d483889 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:08.179586 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-81b25710-7738-4719-9216-e4709d483889 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:08.180251 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-81b25710-7738-4719-9216-e4709d483889 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:08.181213 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-81b25710-7738-4719-9216-e4709d483889 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:08.181740 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-81b25710-7738-4719-9216-e4709d483889 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:08.182235 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-81b25710-7738-4719-9216-e4709d483889 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:08.187802 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-8c653938-a691-48c7-b64e-027ca876c6a0 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:08.198244 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-8c653938-a691-48c7-b64e-027ca876c6a0 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:08.199861 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-8c653938-a691-48c7-b64e-027ca876c6a0 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:08.201023 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-8c653938-a691-48c7-b64e-027ca876c6a0 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1407 microversion: 2.20 time: 0.226029 Nov 02 14:40:08.201582 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 53/102] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:40:07 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:40:08.353290 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-81b25710-7738-4719-9216-e4709d483889 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8706e96002946b2b9bfe87de5c3271a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60403061fba42eba98a7c89987672a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:08.381508 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-81b25710-7738-4719-9216-e4709d483889 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] 10.222.0.30 "GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0" status: 200 len: 1315 microversion: 2.1 time: 0.213928 Nov 02 14:40:08.382801 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 50/103] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:08 2022] GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:40:08.953033 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-033af8b3-6462-4795-82e3-df2fb9e4de15 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:08.953660 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-033af8b3-6462-4795-82e3-df2fb9e4de15 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:08.959881 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-033af8b3-6462-4795-82e3-df2fb9e4de15 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:08.960965 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-033af8b3-6462-4795-82e3-df2fb9e4de15 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:08.960965 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-033af8b3-6462-4795-82e3-df2fb9e4de15 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:08.961754 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-033af8b3-6462-4795-82e3-df2fb9e4de15 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:08.962257 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-033af8b3-6462-4795-82e3-df2fb9e4de15 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:08.962627 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-033af8b3-6462-4795-82e3-df2fb9e4de15 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:09.105722 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-033af8b3-6462-4795-82e3-df2fb9e4de15 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:09.113696 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-033af8b3-6462-4795-82e3-df2fb9e4de15 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1322 microversion: 2.1 time: 0.165657 Nov 02 14:40:09.114280 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 54/104] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:08 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:09.231121 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-b28e5ec5-e48a-47a6-a762-cca16f52f748 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:09.232291 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-b28e5ec5-e48a-47a6-a762-cca16f52f748 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:09.241163 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b28e5ec5-e48a-47a6-a762-cca16f52f748 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:09.241739 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b28e5ec5-e48a-47a6-a762-cca16f52f748 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:09.242458 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b28e5ec5-e48a-47a6-a762-cca16f52f748 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:09.243242 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b28e5ec5-e48a-47a6-a762-cca16f52f748 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:09.243699 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b28e5ec5-e48a-47a6-a762-cca16f52f748 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:09.244132 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b28e5ec5-e48a-47a6-a762-cca16f52f748 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:09.411520 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-8f48e8bf-300c-4802-81f2-1e3bd311a8a6 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:09.412827 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-8f48e8bf-300c-4802-81f2-1e3bd311a8a6 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] [instance: 1ffa9152-f022-466a-ab9b-9977066503d0] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:09.415254 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-b28e5ec5-e48a-47a6-a762-cca16f52f748 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:09.421405 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8f48e8bf-300c-4802-81f2-1e3bd311a8a6 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:09.421985 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8f48e8bf-300c-4802-81f2-1e3bd311a8a6 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:09.422494 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8f48e8bf-300c-4802-81f2-1e3bd311a8a6 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:09.423290 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8f48e8bf-300c-4802-81f2-1e3bd311a8a6 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:09.424057 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8f48e8bf-300c-4802-81f2-1e3bd311a8a6 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:09.424515 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-b28e5ec5-e48a-47a6-a762-cca16f52f748 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:09.424635 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8f48e8bf-300c-4802-81f2-1e3bd311a8a6 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:09.426885 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-b28e5ec5-e48a-47a6-a762-cca16f52f748 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:09.428410 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-b28e5ec5-e48a-47a6-a762-cca16f52f748 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1407 microversion: 2.20 time: 0.205035 Nov 02 14:40:09.429707 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 51/105] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:40:09 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1407 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:40:09.591588 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-8f48e8bf-300c-4802-81f2-1e3bd311a8a6 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8706e96002946b2b9bfe87de5c3271a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60403061fba42eba98a7c89987672a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:09.612555 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-8f48e8bf-300c-4802-81f2-1e3bd311a8a6 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] 10.222.0.30 "GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0" status: 200 len: 1315 microversion: 2.1 time: 0.205946 Nov 02 14:40:09.621957 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 55/106] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:09 2022] GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:10.138041 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-789f2415-8d7b-4283-a073-4e2aa58715a6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:10.138656 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-789f2415-8d7b-4283-a073-4e2aa58715a6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:10.147448 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-789f2415-8d7b-4283-a073-4e2aa58715a6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:10.148028 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-789f2415-8d7b-4283-a073-4e2aa58715a6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:10.148724 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-789f2415-8d7b-4283-a073-4e2aa58715a6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:10.158830 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-789f2415-8d7b-4283-a073-4e2aa58715a6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:10.158830 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-789f2415-8d7b-4283-a073-4e2aa58715a6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:10.158830 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-789f2415-8d7b-4283-a073-4e2aa58715a6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:10.176707 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell1:SELECT=100 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:40:10.324322 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-789f2415-8d7b-4283-a073-4e2aa58715a6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:10.333335 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-789f2415-8d7b-4283-a073-4e2aa58715a6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1322 microversion: 2.1 time: 0.199301 Nov 02 14:40:10.333944 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 52/107] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:10 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:10.455832 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-fa64c56c-914a-4975-a56b-030d86daa75c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:10.456674 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-fa64c56c-914a-4975-a56b-030d86daa75c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:10.463816 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fa64c56c-914a-4975-a56b-030d86daa75c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:10.468848 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fa64c56c-914a-4975-a56b-030d86daa75c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:10.468848 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fa64c56c-914a-4975-a56b-030d86daa75c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:10.468848 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fa64c56c-914a-4975-a56b-030d86daa75c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:10.468848 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fa64c56c-914a-4975-a56b-030d86daa75c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:10.469274 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fa64c56c-914a-4975-a56b-030d86daa75c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:10.600313 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-fa64c56c-914a-4975-a56b-030d86daa75c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:10.609910 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-fa64c56c-914a-4975-a56b-030d86daa75c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:10.611380 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-fa64c56c-914a-4975-a56b-030d86daa75c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:10.612505 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-fa64c56c-914a-4975-a56b-030d86daa75c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1407 microversion: 2.20 time: 0.161566 Nov 02 14:40:10.613102 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 56/108] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:40:10 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:40:10.646619 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-31ee53b8-8330-4463-97f2-2c64668e2c9e tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:10.647787 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-31ee53b8-8330-4463-97f2-2c64668e2c9e tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] [instance: 1ffa9152-f022-466a-ab9b-9977066503d0] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:10.655665 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-31ee53b8-8330-4463-97f2-2c64668e2c9e tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:10.656152 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-31ee53b8-8330-4463-97f2-2c64668e2c9e tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:10.656650 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-31ee53b8-8330-4463-97f2-2c64668e2c9e tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:10.657403 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-31ee53b8-8330-4463-97f2-2c64668e2c9e tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:10.658179 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-31ee53b8-8330-4463-97f2-2c64668e2c9e tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:10.658864 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-31ee53b8-8330-4463-97f2-2c64668e2c9e tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:10.801741 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-31ee53b8-8330-4463-97f2-2c64668e2c9e tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8706e96002946b2b9bfe87de5c3271a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60403061fba42eba98a7c89987672a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:10.809870 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-31ee53b8-8330-4463-97f2-2c64668e2c9e tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] 10.222.0.30 "GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0" status: 200 len: 1315 microversion: 2.1 time: 0.171425 Nov 02 14:40:10.810446 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 53/109] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:10 2022] GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:11.363222 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-98ac592a-6b3c-4848-8edf-98bd60dcc56b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:11.363492 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-98ac592a-6b3c-4848-8edf-98bd60dcc56b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:11.369960 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-98ac592a-6b3c-4848-8edf-98bd60dcc56b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:11.370440 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-98ac592a-6b3c-4848-8edf-98bd60dcc56b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:11.370887 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-98ac592a-6b3c-4848-8edf-98bd60dcc56b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:11.377584 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-98ac592a-6b3c-4848-8edf-98bd60dcc56b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:11.377584 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-98ac592a-6b3c-4848-8edf-98bd60dcc56b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:11.377584 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-98ac592a-6b3c-4848-8edf-98bd60dcc56b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:11.629487 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-98ac592a-6b3c-4848-8edf-98bd60dcc56b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:11.641055 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-98ac592a-6b3c-4848-8edf-98bd60dcc56b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1322 microversion: 2.1 time: 0.284036 Nov 02 14:40:11.642325 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 57/110] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:11 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1322 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:40:11.661146 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-ccb550e7-d569-407a-9dfd-f3837c96c02e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:11.661881 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-ccb550e7-d569-407a-9dfd-f3837c96c02e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:11.668565 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ccb550e7-d569-407a-9dfd-f3837c96c02e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:11.669707 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ccb550e7-d569-407a-9dfd-f3837c96c02e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:11.672413 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ccb550e7-d569-407a-9dfd-f3837c96c02e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:11.675126 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ccb550e7-d569-407a-9dfd-f3837c96c02e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:11.680698 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ccb550e7-d569-407a-9dfd-f3837c96c02e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:11.680698 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ccb550e7-d569-407a-9dfd-f3837c96c02e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:11.838453 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-6e8236d6-6c82-418e-8692-91e97e94bbd8 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:11.843029 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-6e8236d6-6c82-418e-8692-91e97e94bbd8 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] [instance: 1ffa9152-f022-466a-ab9b-9977066503d0] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:11.859512 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-ccb550e7-d569-407a-9dfd-f3837c96c02e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:11.859971 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6e8236d6-6c82-418e-8692-91e97e94bbd8 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:11.860771 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6e8236d6-6c82-418e-8692-91e97e94bbd8 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:11.862271 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6e8236d6-6c82-418e-8692-91e97e94bbd8 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:11.880039 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6e8236d6-6c82-418e-8692-91e97e94bbd8 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:11.880740 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6e8236d6-6c82-418e-8692-91e97e94bbd8 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:11.882949 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6e8236d6-6c82-418e-8692-91e97e94bbd8 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:11.890083 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-ccb550e7-d569-407a-9dfd-f3837c96c02e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:11.893208 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-ccb550e7-d569-407a-9dfd-f3837c96c02e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:11.894936 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-ccb550e7-d569-407a-9dfd-f3837c96c02e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1407 microversion: 2.20 time: 0.239581 Nov 02 14:40:11.901827 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 54/111] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:40:11 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1407 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:40:12.175371 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-6e8236d6-6c82-418e-8692-91e97e94bbd8 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8706e96002946b2b9bfe87de5c3271a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60403061fba42eba98a7c89987672a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:12.196311 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-6e8236d6-6c82-418e-8692-91e97e94bbd8 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] 10.222.0.30 "GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0" status: 200 len: 1315 microversion: 2.1 time: 0.364748 Nov 02 14:40:12.196923 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 58/112] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:11 2022] GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0 => generated 1315 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:12.369745 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [req-84c2e498-28e1-4216-854d-7064a3cf22d5 req-3cf8380e-572d-457f-92f0-b2b399817af8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1620aab-e26a-482d-9816-6fa784243fc9", "name": "network-vif-plugged", "status": "completed", "tag": "c0906b93-2520-43fe-8940-decdff05858b"}]} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:40:12.381652 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-84c2e498-28e1-4216-854d-7064a3cf22d5 req-3cf8380e-572d-457f-92f0-b2b399817af8 service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:12.382509 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-84c2e498-28e1-4216-854d-7064a3cf22d5 req-3cf8380e-572d-457f-92f0-b2b399817af8 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:12.383126 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-84c2e498-28e1-4216-854d-7064a3cf22d5 req-3cf8380e-572d-457f-92f0-b2b399817af8 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:12.397275 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.compute.server_external_events [req-84c2e498-28e1-4216-854d-7064a3cf22d5 req-3cf8380e-572d-457f-92f0-b2b399817af8 service nova] Creating event network-vif-plugged:c0906b93-2520-43fe-8940-decdff05858b for instance d1620aab-e26a-482d-9816-6fa784243fc9 on hv-cinder-86236 Nov 02 14:40:12.403335 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [req-84c2e498-28e1-4216-854d-7064a3cf22d5 req-3cf8380e-572d-457f-92f0-b2b399817af8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037217 Nov 02 14:40:12.403335 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 55/113] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:40:12.667080 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-33c1ce05-68bb-4a6b-ba57-d93f353749e3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:12.667856 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-33c1ce05-68bb-4a6b-ba57-d93f353749e3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:12.674696 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-33c1ce05-68bb-4a6b-ba57-d93f353749e3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:12.675198 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-33c1ce05-68bb-4a6b-ba57-d93f353749e3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:12.675641 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-33c1ce05-68bb-4a6b-ba57-d93f353749e3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:12.676362 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-33c1ce05-68bb-4a6b-ba57-d93f353749e3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:12.676820 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-33c1ce05-68bb-4a6b-ba57-d93f353749e3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:12.677271 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-33c1ce05-68bb-4a6b-ba57-d93f353749e3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:12.883840 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-33c1ce05-68bb-4a6b-ba57-d93f353749e3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:12.893218 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-33c1ce05-68bb-4a6b-ba57-d93f353749e3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1322 microversion: 2.1 time: 0.230033 Nov 02 14:40:12.894102 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 59/114] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:12 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1322 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:12.925317 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-8ab45d87-d7c7-45fc-89c0-7c810af06cac tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:12.925953 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-8ab45d87-d7c7-45fc-89c0-7c810af06cac tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:12.932267 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8ab45d87-d7c7-45fc-89c0-7c810af06cac tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:12.932745 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8ab45d87-d7c7-45fc-89c0-7c810af06cac tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:12.933209 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8ab45d87-d7c7-45fc-89c0-7c810af06cac tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:12.933904 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8ab45d87-d7c7-45fc-89c0-7c810af06cac tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:12.934351 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8ab45d87-d7c7-45fc-89c0-7c810af06cac tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:12.934771 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8ab45d87-d7c7-45fc-89c0-7c810af06cac tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:13.080876 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-8ab45d87-d7c7-45fc-89c0-7c810af06cac tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:13.089918 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-8ab45d87-d7c7-45fc-89c0-7c810af06cac tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:13.091488 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-8ab45d87-d7c7-45fc-89c0-7c810af06cac tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:13.093339 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-8ab45d87-d7c7-45fc-89c0-7c810af06cac tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1407 microversion: 2.20 time: 0.173235 Nov 02 14:40:13.093919 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 56/115] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:40:12 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:40:13.242335 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-2866fb5d-e745-4507-b7c7-7a7e49183abf tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:13.242335 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-2866fb5d-e745-4507-b7c7-7a7e49183abf tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] [instance: 1ffa9152-f022-466a-ab9b-9977066503d0] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:13.242335 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2866fb5d-e745-4507-b7c7-7a7e49183abf tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:13.242335 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2866fb5d-e745-4507-b7c7-7a7e49183abf tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:13.242635 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2866fb5d-e745-4507-b7c7-7a7e49183abf tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:13.242635 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2866fb5d-e745-4507-b7c7-7a7e49183abf tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:13.242635 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2866fb5d-e745-4507-b7c7-7a7e49183abf tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:13.242635 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2866fb5d-e745-4507-b7c7-7a7e49183abf tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:13.382957 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-2866fb5d-e745-4507-b7c7-7a7e49183abf tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8706e96002946b2b9bfe87de5c3271a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60403061fba42eba98a7c89987672a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:13.391605 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-2866fb5d-e745-4507-b7c7-7a7e49183abf tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] 10.222.0.30 "GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0" status: 200 len: 1502 microversion: 2.1 time: 0.171879 Nov 02 14:40:13.392195 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 60/116] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:13 2022] GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0 => generated 1502 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:13.918418 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-9bf63238-55c5-4f31-b224-2e16ddf6b8ab tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:13.919402 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-9bf63238-55c5-4f31-b224-2e16ddf6b8ab tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:13.955347 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9bf63238-55c5-4f31-b224-2e16ddf6b8ab tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:13.956754 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9bf63238-55c5-4f31-b224-2e16ddf6b8ab tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:13.958382 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9bf63238-55c5-4f31-b224-2e16ddf6b8ab tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:13.959375 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9bf63238-55c5-4f31-b224-2e16ddf6b8ab tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:13.960061 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9bf63238-55c5-4f31-b224-2e16ddf6b8ab tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:13.961340 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9bf63238-55c5-4f31-b224-2e16ddf6b8ab tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:14.135222 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-f18dc940-d36b-48a9-8223-dcb6866aed4f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:14.139046 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-f18dc940-d36b-48a9-8223-dcb6866aed4f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:14.158107 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f18dc940-d36b-48a9-8223-dcb6866aed4f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:14.160185 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f18dc940-d36b-48a9-8223-dcb6866aed4f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:14.161230 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f18dc940-d36b-48a9-8223-dcb6866aed4f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:14.164694 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f18dc940-d36b-48a9-8223-dcb6866aed4f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:14.166091 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f18dc940-d36b-48a9-8223-dcb6866aed4f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:14.180201 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f18dc940-d36b-48a9-8223-dcb6866aed4f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:14.322553 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-9bf63238-55c5-4f31-b224-2e16ddf6b8ab tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:14.331341 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-9bf63238-55c5-4f31-b224-2e16ddf6b8ab tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1322 microversion: 2.1 time: 0.416819 Nov 02 14:40:14.332171 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 57/117] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:13 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1322 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:14.389997 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-f18dc940-d36b-48a9-8223-dcb6866aed4f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:14.399173 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-f18dc940-d36b-48a9-8223-dcb6866aed4f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:14.400712 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-f18dc940-d36b-48a9-8223-dcb6866aed4f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:14.401900 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-f18dc940-d36b-48a9-8223-dcb6866aed4f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1407 microversion: 2.20 time: 0.283681 Nov 02 14:40:14.417700 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 61/118] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:40:14 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1407 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:40:14.430631 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [req-acd02b49-daf8-41ea-91c7-4ec3be9ad428 req-5a87344b-f4ed-45e4-9da9-a48ea8be8093 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d0f8129-8155-4b7c-a462-f9c067ecfbca", "name": "network-vif-plugged", "status": "completed", "tag": "af3cc54b-a081-4f0c-aad1-a5c16e7530c7"}]} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:40:14.440129 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-acd02b49-daf8-41ea-91c7-4ec3be9ad428 req-5a87344b-f4ed-45e4-9da9-a48ea8be8093 service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:14.440856 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-acd02b49-daf8-41ea-91c7-4ec3be9ad428 req-5a87344b-f4ed-45e4-9da9-a48ea8be8093 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:14.441506 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-acd02b49-daf8-41ea-91c7-4ec3be9ad428 req-5a87344b-f4ed-45e4-9da9-a48ea8be8093 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:14.459711 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.compute.server_external_events [req-acd02b49-daf8-41ea-91c7-4ec3be9ad428 req-5a87344b-f4ed-45e4-9da9-a48ea8be8093 service nova] Creating event network-vif-plugged:af3cc54b-a081-4f0c-aad1-a5c16e7530c7 for instance 5d0f8129-8155-4b7c-a462-f9c067ecfbca on hv-cinder-86236 Nov 02 14:40:14.461856 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [req-acd02b49-daf8-41ea-91c7-4ec3be9ad428 req-5a87344b-f4ed-45e4-9da9-a48ea8be8093 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042606 Nov 02 14:40:14.462982 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 58/119] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:40:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:40:15.359203 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-bbfad6a8-f3a7-4d61-9e14-7324ebeb075f tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:15.359941 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-bbfad6a8-f3a7-4d61-9e14-7324ebeb075f tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:15.366549 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-bbfad6a8-f3a7-4d61-9e14-7324ebeb075f tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:15.366923 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-bbfad6a8-f3a7-4d61-9e14-7324ebeb075f tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:15.367365 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-bbfad6a8-f3a7-4d61-9e14-7324ebeb075f tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:15.368064 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-bbfad6a8-f3a7-4d61-9e14-7324ebeb075f tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:15.368513 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-bbfad6a8-f3a7-4d61-9e14-7324ebeb075f tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:15.368933 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-bbfad6a8-f3a7-4d61-9e14-7324ebeb075f tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:15.435971 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-b9b2fef9-ff56-4c3b-9df8-7584dffecfa8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:15.438036 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-b9b2fef9-ff56-4c3b-9df8-7584dffecfa8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:15.444755 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b9b2fef9-ff56-4c3b-9df8-7584dffecfa8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:15.445976 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b9b2fef9-ff56-4c3b-9df8-7584dffecfa8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:15.447053 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b9b2fef9-ff56-4c3b-9df8-7584dffecfa8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:15.448823 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b9b2fef9-ff56-4c3b-9df8-7584dffecfa8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:15.449696 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b9b2fef9-ff56-4c3b-9df8-7584dffecfa8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:15.450133 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b9b2fef9-ff56-4c3b-9df8-7584dffecfa8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:15.558734 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-bbfad6a8-f3a7-4d61-9e14-7324ebeb075f tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:15.586078 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-bbfad6a8-f3a7-4d61-9e14-7324ebeb075f tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1322 microversion: 2.1 time: 0.232231 Nov 02 14:40:15.588315 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 62/120] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:15 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1322 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:15.679904 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-b9b2fef9-ff56-4c3b-9df8-7584dffecfa8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:15.689083 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-b9b2fef9-ff56-4c3b-9df8-7584dffecfa8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:15.690524 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-b9b2fef9-ff56-4c3b-9df8-7584dffecfa8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:15.691612 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-b9b2fef9-ff56-4c3b-9df8-7584dffecfa8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1407 microversion: 2.20 time: 0.264584 Nov 02 14:40:15.692191 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 59/121] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:40:15 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1407 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:40:15.774893 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-b2123220-f6c9-44bb-a3c6-dbee0b53cfd9 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c59cff92-cfe3-4dc2-a6d9-e7cb50509ae1"}} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:40:15.778053 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-b2123220-f6c9-44bb-a3c6-dbee0b53cfd9 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] [instance: 1ffa9152-f022-466a-ab9b-9977066503d0] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:15.787860 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b2123220-f6c9-44bb-a3c6-dbee0b53cfd9 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:15.788663 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b2123220-f6c9-44bb-a3c6-dbee0b53cfd9 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:15.789426 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b2123220-f6c9-44bb-a3c6-dbee0b53cfd9 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:15.790301 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b2123220-f6c9-44bb-a3c6-dbee0b53cfd9 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:15.790894 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b2123220-f6c9-44bb-a3c6-dbee0b53cfd9 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:15.791455 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b2123220-f6c9-44bb-a3c6-dbee0b53cfd9 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:16.615151 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-5a7e1234-1500-48da-ad64-d8502f9305c4 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:16.616321 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-5a7e1234-1500-48da-ad64-d8502f9305c4 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:16.626844 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5a7e1234-1500-48da-ad64-d8502f9305c4 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:16.627329 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5a7e1234-1500-48da-ad64-d8502f9305c4 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:16.628341 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5a7e1234-1500-48da-ad64-d8502f9305c4 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:16.629407 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5a7e1234-1500-48da-ad64-d8502f9305c4 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:16.629866 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5a7e1234-1500-48da-ad64-d8502f9305c4 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:16.631008 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5a7e1234-1500-48da-ad64-d8502f9305c4 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:16.806899 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-5a7e1234-1500-48da-ad64-d8502f9305c4 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:16.815407 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-5a7e1234-1500-48da-ad64-d8502f9305c4 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1517 microversion: 2.1 time: 0.205888 Nov 02 14:40:16.815984 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 60/122] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:16 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1517 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:16.820523 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-e07e6f27-3979-4c81-8b01-72b6e6163b02 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:16.821216 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-e07e6f27-3979-4c81-8b01-72b6e6163b02 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:16.827926 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e07e6f27-3979-4c81-8b01-72b6e6163b02 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:16.828400 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e07e6f27-3979-4c81-8b01-72b6e6163b02 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:16.828827 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e07e6f27-3979-4c81-8b01-72b6e6163b02 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:16.829537 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e07e6f27-3979-4c81-8b01-72b6e6163b02 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:16.829971 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e07e6f27-3979-4c81-8b01-72b6e6163b02 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:16.830382 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e07e6f27-3979-4c81-8b01-72b6e6163b02 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:17.013154 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-e07e6f27-3979-4c81-8b01-72b6e6163b02 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:17.054907 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-e07e6f27-3979-4c81-8b01-72b6e6163b02 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:17.055616 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-e07e6f27-3979-4c81-8b01-72b6e6163b02 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:17.057341 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-e07e6f27-3979-4c81-8b01-72b6e6163b02 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1407 microversion: 2.20 time: 0.240324 Nov 02 14:40:17.058168 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 61/123] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:40:16 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1407 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:40:17.064852 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-dd41794a-5e0f-4639-b50a-9b6fc2f860ce tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:40:17.069383 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-dd41794a-5e0f-4639-b50a-9b6fc2f860ce tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:17.077928 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-dd41794a-5e0f-4639-b50a-9b6fc2f860ce tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:17.078780 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-dd41794a-5e0f-4639-b50a-9b6fc2f860ce tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:17.079254 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-dd41794a-5e0f-4639-b50a-9b6fc2f860ce tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:17.079884 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-dd41794a-5e0f-4639-b50a-9b6fc2f860ce tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:17.080575 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-dd41794a-5e0f-4639-b50a-9b6fc2f860ce tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:17.081504 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-dd41794a-5e0f-4639-b50a-9b6fc2f860ce tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:17.158589 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.objects.instance [None req-dd41794a-5e0f-4639-b50a-9b6fc2f860ce tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lazy-loading 'flavor' on Instance uuid d1620aab-e26a-482d-9816-6fa784243fc9 {{(pid=119658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:40:17.570001 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-dd41794a-5e0f-4639-b50a-9b6fc2f860ce tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "POST /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9/action" status: 200 len: 32 microversion: 2.1 time: 0.509861 Nov 02 14:40:17.571280 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 62/124] 10.222.0.30 () {60 vars in 1278 bytes} [Wed Nov 2 14:40:17 2022] POST /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9/action => generated 32 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 14:40:17.598006 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-095074e0-791b-4759-b004-79005fb17821 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:17.598006 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-095074e0-791b-4759-b004-79005fb17821 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:17.603071 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-095074e0-791b-4759-b004-79005fb17821 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:17.604119 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-095074e0-791b-4759-b004-79005fb17821 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:17.604963 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-095074e0-791b-4759-b004-79005fb17821 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:17.606484 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-095074e0-791b-4759-b004-79005fb17821 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:17.607935 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-095074e0-791b-4759-b004-79005fb17821 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:17.608716 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-095074e0-791b-4759-b004-79005fb17821 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:17.676906 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-b2123220-f6c9-44bb-a3c6-dbee0b53cfd9 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] 10.222.0.30 "POST /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.906305 Nov 02 14:40:17.678159 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 63/125] 10.222.0.30 () {60 vars in 1323 bytes} [Wed Nov 2 14:40:15 2022] POST /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0/os-volume_attachments => generated 194 bytes in 1909 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:40:17.806488 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-095074e0-791b-4759-b004-79005fb17821 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:17.814959 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-095074e0-791b-4759-b004-79005fb17821 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1523 microversion: 2.1 time: 0.226987 Nov 02 14:40:17.815531 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 63/126] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:17 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1523 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:18.084811 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-70ff77d6-b829-4a6c-9d21-d8e7e9e2eb34 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:18.085482 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-70ff77d6-b829-4a6c-9d21-d8e7e9e2eb34 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:18.097059 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-70ff77d6-b829-4a6c-9d21-d8e7e9e2eb34 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:18.098780 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-70ff77d6-b829-4a6c-9d21-d8e7e9e2eb34 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:18.099226 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-70ff77d6-b829-4a6c-9d21-d8e7e9e2eb34 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:18.101438 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-70ff77d6-b829-4a6c-9d21-d8e7e9e2eb34 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:18.102068 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-70ff77d6-b829-4a6c-9d21-d8e7e9e2eb34 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:18.108376 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-70ff77d6-b829-4a6c-9d21-d8e7e9e2eb34 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:18.119014 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:40:18.473128 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-70ff77d6-b829-4a6c-9d21-d8e7e9e2eb34 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:18.482033 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-70ff77d6-b829-4a6c-9d21-d8e7e9e2eb34 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:18.483715 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-70ff77d6-b829-4a6c-9d21-d8e7e9e2eb34 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:18.484848 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-70ff77d6-b829-4a6c-9d21-d8e7e9e2eb34 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1407 microversion: 2.20 time: 0.404937 Nov 02 14:40:18.485430 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 64/127] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:40:18 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1407 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:40:18.838388 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-a8f18aeb-ec72-4e89-b383-42d40c978d04 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:18.839714 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-a8f18aeb-ec72-4e89-b383-42d40c978d04 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:18.846927 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a8f18aeb-ec72-4e89-b383-42d40c978d04 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:18.847559 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a8f18aeb-ec72-4e89-b383-42d40c978d04 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:18.848100 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a8f18aeb-ec72-4e89-b383-42d40c978d04 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:18.848912 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a8f18aeb-ec72-4e89-b383-42d40c978d04 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:18.849616 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a8f18aeb-ec72-4e89-b383-42d40c978d04 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:18.850408 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a8f18aeb-ec72-4e89-b383-42d40c978d04 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:19.086099 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-a8f18aeb-ec72-4e89-b383-42d40c978d04 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:19.096455 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-a8f18aeb-ec72-4e89-b383-42d40c978d04 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1523 microversion: 2.1 time: 0.261834 Nov 02 14:40:19.097407 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 64/128] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:18 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1523 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:19.511354 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-e21b0c45-8884-4b72-9d53-3a8100798e73 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:19.512556 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-e21b0c45-8884-4b72-9d53-3a8100798e73 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:19.546158 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e21b0c45-8884-4b72-9d53-3a8100798e73 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:19.547150 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e21b0c45-8884-4b72-9d53-3a8100798e73 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:19.549641 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e21b0c45-8884-4b72-9d53-3a8100798e73 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:19.550633 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e21b0c45-8884-4b72-9d53-3a8100798e73 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:19.552319 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e21b0c45-8884-4b72-9d53-3a8100798e73 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:19.552954 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e21b0c45-8884-4b72-9d53-3a8100798e73 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:19.751319 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-e21b0c45-8884-4b72-9d53-3a8100798e73 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:19.759711 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-e21b0c45-8884-4b72-9d53-3a8100798e73 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:19.761263 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-e21b0c45-8884-4b72-9d53-3a8100798e73 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:19.764354 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-e21b0c45-8884-4b72-9d53-3a8100798e73 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1599 microversion: 2.20 time: 0.258120 Nov 02 14:40:19.765397 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 65/129] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:40:19 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1599 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:40:19.793156 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-c86cba60-042b-4124-9244-674f809c0413 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:19.793688 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-c86cba60-042b-4124-9244-674f809c0413 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:19.800426 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c86cba60-042b-4124-9244-674f809c0413 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:19.801307 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c86cba60-042b-4124-9244-674f809c0413 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:19.801734 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c86cba60-042b-4124-9244-674f809c0413 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:19.802477 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c86cba60-042b-4124-9244-674f809c0413 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:19.803000 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c86cba60-042b-4124-9244-674f809c0413 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:19.803329 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c86cba60-042b-4124-9244-674f809c0413 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:19.895263 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-c86cba60-042b-4124-9244-674f809c0413 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.106450 Nov 02 14:40:19.895837 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 65/130] 10.222.0.30 () {60 vars in 1316 bytes} [Wed Nov 2 14:40:19 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca/os-interface => generated 285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 14:40:20.122278 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-4751bf00-6591-49b0-8b99-a8201f79df22 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:20.126514 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-4751bf00-6591-49b0-8b99-a8201f79df22 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:20.130527 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4751bf00-6591-49b0-8b99-a8201f79df22 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:20.131435 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4751bf00-6591-49b0-8b99-a8201f79df22 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:20.132054 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4751bf00-6591-49b0-8b99-a8201f79df22 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:20.132777 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4751bf00-6591-49b0-8b99-a8201f79df22 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:20.133290 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4751bf00-6591-49b0-8b99-a8201f79df22 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:20.133711 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4751bf00-6591-49b0-8b99-a8201f79df22 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:20.366716 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-4751bf00-6591-49b0-8b99-a8201f79df22 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:20.383411 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-4751bf00-6591-49b0-8b99-a8201f79df22 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1523 microversion: 2.1 time: 0.266740 Nov 02 14:40:20.385627 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 66/131] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:20 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1523 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:21.413111 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-21f975df-b386-4179-a1c2-30ab3f033169 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:21.414141 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-21f975df-b386-4179-a1c2-30ab3f033169 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:21.425335 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-21f975df-b386-4179-a1c2-30ab3f033169 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:21.426061 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-21f975df-b386-4179-a1c2-30ab3f033169 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:21.427285 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-21f975df-b386-4179-a1c2-30ab3f033169 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:21.428659 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-21f975df-b386-4179-a1c2-30ab3f033169 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:21.430190 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-21f975df-b386-4179-a1c2-30ab3f033169 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:21.432710 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-21f975df-b386-4179-a1c2-30ab3f033169 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:21.623197 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-21f975df-b386-4179-a1c2-30ab3f033169 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:21.633284 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [req-c7b86472-b2de-4ee0-aa1c-11560192f480 req-fa3b0814-142e-4eda-976b-013a382c2282 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d0f8129-8155-4b7c-a462-f9c067ecfbca", "tag": "af3cc54b-a081-4f0c-aad1-a5c16e7530c7"}]} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:40:21.634014 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-21f975df-b386-4179-a1c2-30ab3f033169 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1523 microversion: 2.1 time: 0.228455 Nov 02 14:40:21.640550 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 66/132] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:21 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1523 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:21.644711 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-c7b86472-b2de-4ee0-aa1c-11560192f480 req-fa3b0814-142e-4eda-976b-013a382c2282 service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:21.645211 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-c7b86472-b2de-4ee0-aa1c-11560192f480 req-fa3b0814-142e-4eda-976b-013a382c2282 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:21.645634 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-c7b86472-b2de-4ee0-aa1c-11560192f480 req-fa3b0814-142e-4eda-976b-013a382c2282 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:21.663451 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.compute.server_external_events [req-c7b86472-b2de-4ee0-aa1c-11560192f480 req-fa3b0814-142e-4eda-976b-013a382c2282 service nova] Creating event network-changed:af3cc54b-a081-4f0c-aad1-a5c16e7530c7 for instance 5d0f8129-8155-4b7c-a462-f9c067ecfbca on hv-cinder-86236 Nov 02 14:40:21.668617 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [req-c7b86472-b2de-4ee0-aa1c-11560192f480 req-fa3b0814-142e-4eda-976b-013a382c2282 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039258 Nov 02 14:40:21.670768 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 67/133] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:40:22.665031 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-8ef5b254-4b92-4d52-b334-9c5d44f1d9f3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:22.666080 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-8ef5b254-4b92-4d52-b334-9c5d44f1d9f3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:22.686147 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8ef5b254-4b92-4d52-b334-9c5d44f1d9f3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:22.690998 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8ef5b254-4b92-4d52-b334-9c5d44f1d9f3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:22.690998 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8ef5b254-4b92-4d52-b334-9c5d44f1d9f3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:22.690998 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8ef5b254-4b92-4d52-b334-9c5d44f1d9f3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:22.690998 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8ef5b254-4b92-4d52-b334-9c5d44f1d9f3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:22.691382 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8ef5b254-4b92-4d52-b334-9c5d44f1d9f3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:22.889057 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-8ef5b254-4b92-4d52-b334-9c5d44f1d9f3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:22.909446 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-8ef5b254-4b92-4d52-b334-9c5d44f1d9f3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1523 microversion: 2.1 time: 0.251222 Nov 02 14:40:22.909446 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 67/134] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:22 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1523 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:40:23.941720 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-ef8f509c-ea82-4454-ba4e-eb8e9bcc014e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:23.942407 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-ef8f509c-ea82-4454-ba4e-eb8e9bcc014e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:23.949579 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ef8f509c-ea82-4454-ba4e-eb8e9bcc014e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:23.950284 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ef8f509c-ea82-4454-ba4e-eb8e9bcc014e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:23.951111 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ef8f509c-ea82-4454-ba4e-eb8e9bcc014e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:23.951988 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ef8f509c-ea82-4454-ba4e-eb8e9bcc014e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:23.957323 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ef8f509c-ea82-4454-ba4e-eb8e9bcc014e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:23.957323 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ef8f509c-ea82-4454-ba4e-eb8e9bcc014e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:24.108756 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-ef8f509c-ea82-4454-ba4e-eb8e9bcc014e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:24.118756 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-ef8f509c-ea82-4454-ba4e-eb8e9bcc014e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1523 microversion: 2.1 time: 0.181874 Nov 02 14:40:24.119483 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 68/135] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:23 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:25.157630 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-0a09baf5-bc83-44d9-a0b2-9bb4d95fbac1 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:25.158243 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-0a09baf5-bc83-44d9-a0b2-9bb4d95fbac1 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:25.164176 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0a09baf5-bc83-44d9-a0b2-9bb4d95fbac1 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:25.164656 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0a09baf5-bc83-44d9-a0b2-9bb4d95fbac1 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:25.165127 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0a09baf5-bc83-44d9-a0b2-9bb4d95fbac1 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:25.165817 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0a09baf5-bc83-44d9-a0b2-9bb4d95fbac1 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:25.166259 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0a09baf5-bc83-44d9-a0b2-9bb4d95fbac1 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:25.166678 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0a09baf5-bc83-44d9-a0b2-9bb4d95fbac1 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:25.320659 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-0a09baf5-bc83-44d9-a0b2-9bb4d95fbac1 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:25.324493 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:40:25.330383 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-0a09baf5-bc83-44d9-a0b2-9bb4d95fbac1 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1523 microversion: 2.1 time: 0.177603 Nov 02 14:40:25.332077 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 68/136] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:25 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1523 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:26.356184 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-db7d39e9-ecb2-4cb1-8e00-f909145eeff7 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:26.357628 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-db7d39e9-ecb2-4cb1-8e00-f909145eeff7 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:26.364592 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-db7d39e9-ecb2-4cb1-8e00-f909145eeff7 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:26.365111 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-db7d39e9-ecb2-4cb1-8e00-f909145eeff7 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:26.365575 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-db7d39e9-ecb2-4cb1-8e00-f909145eeff7 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:26.366412 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-db7d39e9-ecb2-4cb1-8e00-f909145eeff7 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:26.366866 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-db7d39e9-ecb2-4cb1-8e00-f909145eeff7 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:26.367315 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-db7d39e9-ecb2-4cb1-8e00-f909145eeff7 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:26.550164 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-db7d39e9-ecb2-4cb1-8e00-f909145eeff7 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:26.558415 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-db7d39e9-ecb2-4cb1-8e00-f909145eeff7 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1523 microversion: 2.1 time: 0.206419 Nov 02 14:40:26.558991 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 69/137] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:26 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1523 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:27.583180 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-068bc13b-46d1-4c34-95a8-ab3831b6885e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:27.584914 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-068bc13b-46d1-4c34-95a8-ab3831b6885e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:27.603000 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-068bc13b-46d1-4c34-95a8-ab3831b6885e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:27.603938 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-068bc13b-46d1-4c34-95a8-ab3831b6885e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:27.610185 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-068bc13b-46d1-4c34-95a8-ab3831b6885e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:27.612559 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-068bc13b-46d1-4c34-95a8-ab3831b6885e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:27.616836 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-068bc13b-46d1-4c34-95a8-ab3831b6885e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:27.623981 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-068bc13b-46d1-4c34-95a8-ab3831b6885e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:27.880050 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-068bc13b-46d1-4c34-95a8-ab3831b6885e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:27.895008 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-068bc13b-46d1-4c34-95a8-ab3831b6885e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1523 microversion: 2.1 time: 0.316055 Nov 02 14:40:27.897491 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 69/138] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:27 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1523 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:28.926013 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-d9a0f9d0-9062-449a-ade9-165f2fefb137 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:28.926620 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-d9a0f9d0-9062-449a-ade9-165f2fefb137 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:28.933335 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d9a0f9d0-9062-449a-ade9-165f2fefb137 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:28.933742 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d9a0f9d0-9062-449a-ade9-165f2fefb137 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:28.934182 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d9a0f9d0-9062-449a-ade9-165f2fefb137 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:28.935506 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d9a0f9d0-9062-449a-ade9-165f2fefb137 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:28.935954 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d9a0f9d0-9062-449a-ade9-165f2fefb137 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:28.936383 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d9a0f9d0-9062-449a-ade9-165f2fefb137 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:29.192798 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-d9a0f9d0-9062-449a-ade9-165f2fefb137 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:29.203100 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-d9a0f9d0-9062-449a-ade9-165f2fefb137 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1523 microversion: 2.1 time: 0.280842 Nov 02 14:40:29.203697 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 70/139] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:28 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1523 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:30.229953 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-8f3b7ab2-7e15-45bc-9386-b1ef2ebba1b2 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:30.230615 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-8f3b7ab2-7e15-45bc-9386-b1ef2ebba1b2 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:30.237980 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8f3b7ab2-7e15-45bc-9386-b1ef2ebba1b2 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:30.238460 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8f3b7ab2-7e15-45bc-9386-b1ef2ebba1b2 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:30.238891 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8f3b7ab2-7e15-45bc-9386-b1ef2ebba1b2 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:30.239578 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8f3b7ab2-7e15-45bc-9386-b1ef2ebba1b2 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:30.240075 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8f3b7ab2-7e15-45bc-9386-b1ef2ebba1b2 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:30.240486 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8f3b7ab2-7e15-45bc-9386-b1ef2ebba1b2 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:30.390043 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-8f3b7ab2-7e15-45bc-9386-b1ef2ebba1b2 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:30.410029 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-8f3b7ab2-7e15-45bc-9386-b1ef2ebba1b2 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1523 microversion: 2.1 time: 0.183293 Nov 02 14:40:30.411179 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 70/140] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:30 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:40:30.728022 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-5536150e-91b1-4445-9824-b6e59cfa578c tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:30.728595 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-5536150e-91b1-4445-9824-b6e59cfa578c tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] [instance: 1ffa9152-f022-466a-ab9b-9977066503d0] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:30.732112 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_api:SELECT=67 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:40:30.740818 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5536150e-91b1-4445-9824-b6e59cfa578c tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:30.741524 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5536150e-91b1-4445-9824-b6e59cfa578c tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:30.742295 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5536150e-91b1-4445-9824-b6e59cfa578c tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:30.743234 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5536150e-91b1-4445-9824-b6e59cfa578c tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:30.743873 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5536150e-91b1-4445-9824-b6e59cfa578c tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:30.744504 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5536150e-91b1-4445-9824-b6e59cfa578c tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:30.772245 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-5536150e-91b1-4445-9824-b6e59cfa578c tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] [instance: 1ffa9152-f022-466a-ab9b-9977066503d0] Going to try to terminate instance {{(pid=119659) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:40:31.111461 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-5536150e-91b1-4445-9824-b6e59cfa578c tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0" status: 204 len: 0 microversion: 2.1 time: 0.387216 Nov 02 14:40:31.112093 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 71/141] 10.222.0.30 () {58 vars in 1239 bytes} [Wed Nov 2 14:40:30 2022] DELETE /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 14:40:31.120706 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-e30c4d36-4e8a-47b4-8af2-206cc4dfea3f tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:31.121358 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-e30c4d36-4e8a-47b4-8af2-206cc4dfea3f tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] [instance: 1ffa9152-f022-466a-ab9b-9977066503d0] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:31.124442 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_api:SELECT=68 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:40:31.134354 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e30c4d36-4e8a-47b4-8af2-206cc4dfea3f tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:31.134354 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e30c4d36-4e8a-47b4-8af2-206cc4dfea3f tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:31.134354 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e30c4d36-4e8a-47b4-8af2-206cc4dfea3f tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:31.134354 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e30c4d36-4e8a-47b4-8af2-206cc4dfea3f tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:31.134828 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e30c4d36-4e8a-47b4-8af2-206cc4dfea3f tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:31.135592 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e30c4d36-4e8a-47b4-8af2-206cc4dfea3f tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:31.287249 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-e30c4d36-4e8a-47b4-8af2-206cc4dfea3f tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8706e96002946b2b9bfe87de5c3271a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60403061fba42eba98a7c89987672a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:31.296089 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-e30c4d36-4e8a-47b4-8af2-206cc4dfea3f tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] 10.222.0.30 "GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0" status: 200 len: 1554 microversion: 2.1 time: 0.179465 Nov 02 14:40:31.296712 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 71/142] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:31 2022] GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0 => generated 1554 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:31.436158 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-cb0628ac-aab5-46fc-952f-2dbb00084763 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:31.436865 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-cb0628ac-aab5-46fc-952f-2dbb00084763 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:31.443989 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-cb0628ac-aab5-46fc-952f-2dbb00084763 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:31.444481 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-cb0628ac-aab5-46fc-952f-2dbb00084763 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:31.444912 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-cb0628ac-aab5-46fc-952f-2dbb00084763 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:31.445915 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-cb0628ac-aab5-46fc-952f-2dbb00084763 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:31.446576 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-cb0628ac-aab5-46fc-952f-2dbb00084763 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:31.446951 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-cb0628ac-aab5-46fc-952f-2dbb00084763 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:31.592405 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-cb0628ac-aab5-46fc-952f-2dbb00084763 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:31.600641 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-cb0628ac-aab5-46fc-952f-2dbb00084763 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1523 microversion: 2.1 time: 0.169489 Nov 02 14:40:31.601281 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 72/143] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:31 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:32.320863 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-59f3fdf2-dd27-43ca-bb69-2163a1df28e7 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:32.322268 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-59f3fdf2-dd27-43ca-bb69-2163a1df28e7 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] [instance: 1ffa9152-f022-466a-ab9b-9977066503d0] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:32.330396 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-59f3fdf2-dd27-43ca-bb69-2163a1df28e7 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:32.330894 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-59f3fdf2-dd27-43ca-bb69-2163a1df28e7 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:32.331349 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-59f3fdf2-dd27-43ca-bb69-2163a1df28e7 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:32.332076 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-59f3fdf2-dd27-43ca-bb69-2163a1df28e7 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:32.332687 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-59f3fdf2-dd27-43ca-bb69-2163a1df28e7 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:32.333136 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-59f3fdf2-dd27-43ca-bb69-2163a1df28e7 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:32.492133 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-59f3fdf2-dd27-43ca-bb69-2163a1df28e7 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8706e96002946b2b9bfe87de5c3271a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60403061fba42eba98a7c89987672a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:32.541403 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-59f3fdf2-dd27-43ca-bb69-2163a1df28e7 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] 10.222.0.30 "GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0" status: 200 len: 1554 microversion: 2.1 time: 0.209565 Nov 02 14:40:32.541403 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 72/144] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:32 2022] GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0 => generated 1554 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:32.625504 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-f01eb085-147b-444d-a187-b10efbbdd84b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:32.626275 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-f01eb085-147b-444d-a187-b10efbbdd84b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:32.639127 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f01eb085-147b-444d-a187-b10efbbdd84b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:32.639605 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f01eb085-147b-444d-a187-b10efbbdd84b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:32.640034 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f01eb085-147b-444d-a187-b10efbbdd84b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:32.640712 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f01eb085-147b-444d-a187-b10efbbdd84b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:32.641429 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f01eb085-147b-444d-a187-b10efbbdd84b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:32.642218 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f01eb085-147b-444d-a187-b10efbbdd84b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:32.814293 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-f01eb085-147b-444d-a187-b10efbbdd84b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:32.822055 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-f01eb085-147b-444d-a187-b10efbbdd84b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1523 microversion: 2.1 time: 0.201185 Nov 02 14:40:32.822662 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 73/145] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:32 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1523 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:33.559129 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-b6356536-2235-4023-875f-5f6659cf34a3 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:33.560485 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-b6356536-2235-4023-875f-5f6659cf34a3 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] [instance: 1ffa9152-f022-466a-ab9b-9977066503d0] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:33.566494 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b6356536-2235-4023-875f-5f6659cf34a3 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:33.566971 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b6356536-2235-4023-875f-5f6659cf34a3 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:33.567415 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b6356536-2235-4023-875f-5f6659cf34a3 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:33.568132 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b6356536-2235-4023-875f-5f6659cf34a3 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:33.568521 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b6356536-2235-4023-875f-5f6659cf34a3 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:33.568933 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b6356536-2235-4023-875f-5f6659cf34a3 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:33.726100 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-b6356536-2235-4023-875f-5f6659cf34a3 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8706e96002946b2b9bfe87de5c3271a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60403061fba42eba98a7c89987672a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:33.734898 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-b6356536-2235-4023-875f-5f6659cf34a3 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] 10.222.0.30 "GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0" status: 200 len: 1554 microversion: 2.1 time: 0.179566 Nov 02 14:40:33.735477 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 73/146] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:33 2022] GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0 => generated 1554 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:33.845207 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-697d61b7-99f2-4a2a-b343-71048afcc275 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:33.845852 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-697d61b7-99f2-4a2a-b343-71048afcc275 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:33.852833 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-697d61b7-99f2-4a2a-b343-71048afcc275 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:33.854556 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-697d61b7-99f2-4a2a-b343-71048afcc275 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:33.854556 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-697d61b7-99f2-4a2a-b343-71048afcc275 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:33.854556 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-697d61b7-99f2-4a2a-b343-71048afcc275 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:33.854951 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-697d61b7-99f2-4a2a-b343-71048afcc275 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:33.855423 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-697d61b7-99f2-4a2a-b343-71048afcc275 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:34.351613 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-697d61b7-99f2-4a2a-b343-71048afcc275 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:34.374367 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-697d61b7-99f2-4a2a-b343-71048afcc275 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1523 microversion: 2.1 time: 0.532939 Nov 02 14:40:34.374950 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 74/147] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:33 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1523 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:34.762205 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-28733a0c-f01d-4794-81b1-657f15a30576 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:34.763903 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-28733a0c-f01d-4794-81b1-657f15a30576 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] [instance: 1ffa9152-f022-466a-ab9b-9977066503d0] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:34.773747 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-28733a0c-f01d-4794-81b1-657f15a30576 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:34.774655 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-28733a0c-f01d-4794-81b1-657f15a30576 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:34.775308 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-28733a0c-f01d-4794-81b1-657f15a30576 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:34.776371 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-28733a0c-f01d-4794-81b1-657f15a30576 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:34.777192 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-28733a0c-f01d-4794-81b1-657f15a30576 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:34.777827 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-28733a0c-f01d-4794-81b1-657f15a30576 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:34.947982 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-28733a0c-f01d-4794-81b1-657f15a30576 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8706e96002946b2b9bfe87de5c3271a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60403061fba42eba98a7c89987672a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:34.958907 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-28733a0c-f01d-4794-81b1-657f15a30576 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] 10.222.0.30 "GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0" status: 200 len: 1512 microversion: 2.1 time: 0.201281 Nov 02 14:40:34.974775 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 74/148] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:34 2022] GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0 => generated 1512 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:35.018948 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [req-09d9e861-e40c-46a7-9bfe-9acabbdfe5d6 req-5845f419-a7cf-4f32-93f7-d2502d47c113 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ffa9152-f022-466a-ab9b-9977066503d0", "name": "network-vif-deleted", "tag": "34a3ffa0-db81-40b1-8b9b-0d40f164bd30"}]} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:40:35.030607 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-09d9e861-e40c-46a7-9bfe-9acabbdfe5d6 req-5845f419-a7cf-4f32-93f7-d2502d47c113 service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:35.031291 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-09d9e861-e40c-46a7-9bfe-9acabbdfe5d6 req-5845f419-a7cf-4f32-93f7-d2502d47c113 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:35.031772 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-09d9e861-e40c-46a7-9bfe-9acabbdfe5d6 req-5845f419-a7cf-4f32-93f7-d2502d47c113 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:35.045534 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.compute.server_external_events [req-09d9e861-e40c-46a7-9bfe-9acabbdfe5d6 req-5845f419-a7cf-4f32-93f7-d2502d47c113 service nova] Creating event network-vif-deleted:34a3ffa0-db81-40b1-8b9b-0d40f164bd30 for instance 1ffa9152-f022-466a-ab9b-9977066503d0 on hv-cinder-86236 Nov 02 14:40:35.052387 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [req-09d9e861-e40c-46a7-9bfe-9acabbdfe5d6 req-5845f419-a7cf-4f32-93f7-d2502d47c113 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041126 Nov 02 14:40:35.053025 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 75/149] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:40:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:40:35.398839 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-dcd7d0c4-f8cf-4e32-81d3-46e280be2192 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:35.399530 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-dcd7d0c4-f8cf-4e32-81d3-46e280be2192 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:35.408284 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-dcd7d0c4-f8cf-4e32-81d3-46e280be2192 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:35.408815 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-dcd7d0c4-f8cf-4e32-81d3-46e280be2192 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:35.409591 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-dcd7d0c4-f8cf-4e32-81d3-46e280be2192 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:35.410577 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-dcd7d0c4-f8cf-4e32-81d3-46e280be2192 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:35.411210 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-dcd7d0c4-f8cf-4e32-81d3-46e280be2192 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:35.411669 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-dcd7d0c4-f8cf-4e32-81d3-46e280be2192 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:35.558900 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-dcd7d0c4-f8cf-4e32-81d3-46e280be2192 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:35.567572 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-dcd7d0c4-f8cf-4e32-81d3-46e280be2192 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1523 microversion: 2.1 time: 0.172530 Nov 02 14:40:35.568686 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 75/150] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:35 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:35.989346 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-0e4ffeae-7a18-446d-be48-f6c282e9d48a tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:35.990619 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-0e4ffeae-7a18-446d-be48-f6c282e9d48a tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] [instance: 1ffa9152-f022-466a-ab9b-9977066503d0] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:35.997076 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0e4ffeae-7a18-446d-be48-f6c282e9d48a tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:35.997671 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0e4ffeae-7a18-446d-be48-f6c282e9d48a tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:35.998169 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0e4ffeae-7a18-446d-be48-f6c282e9d48a tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:35.999059 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0e4ffeae-7a18-446d-be48-f6c282e9d48a tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:35.999507 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0e4ffeae-7a18-446d-be48-f6c282e9d48a tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:35.999953 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0e4ffeae-7a18-446d-be48-f6c282e9d48a tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:36.070074 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-0e4ffeae-7a18-446d-be48-f6c282e9d48a tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8706e96002946b2b9bfe87de5c3271a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60403061fba42eba98a7c89987672a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:36.080017 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-0e4ffeae-7a18-446d-be48-f6c282e9d48a tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] 10.222.0.30 "GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0" status: 200 len: 1346 microversion: 2.1 time: 0.095001 Nov 02 14:40:36.091440 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 76/151] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:35 2022] GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0 => generated 1346 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:36.592786 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-6b51c08f-8353-4b39-999a-a9cfa180b265 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:36.593488 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-6b51c08f-8353-4b39-999a-a9cfa180b265 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:36.599700 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6b51c08f-8353-4b39-999a-a9cfa180b265 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:36.600378 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6b51c08f-8353-4b39-999a-a9cfa180b265 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:36.600813 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6b51c08f-8353-4b39-999a-a9cfa180b265 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:36.601530 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6b51c08f-8353-4b39-999a-a9cfa180b265 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:36.601972 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6b51c08f-8353-4b39-999a-a9cfa180b265 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:36.602391 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6b51c08f-8353-4b39-999a-a9cfa180b265 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:36.747951 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-6b51c08f-8353-4b39-999a-a9cfa180b265 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:36.756560 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-6b51c08f-8353-4b39-999a-a9cfa180b265 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1523 microversion: 2.1 time: 0.167654 Nov 02 14:40:36.757962 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 76/152] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:36 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:37.109638 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-25904715-a3f2-4e04-ae34-d26e919682d3 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:37.113067 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-25904715-a3f2-4e04-ae34-d26e919682d3 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] [instance: 1ffa9152-f022-466a-ab9b-9977066503d0] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:37.120710 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-25904715-a3f2-4e04-ae34-d26e919682d3 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:37.121224 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-25904715-a3f2-4e04-ae34-d26e919682d3 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:37.121656 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-25904715-a3f2-4e04-ae34-d26e919682d3 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:37.123373 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-25904715-a3f2-4e04-ae34-d26e919682d3 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:37.123524 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-25904715-a3f2-4e04-ae34-d26e919682d3 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:37.123884 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-25904715-a3f2-4e04-ae34-d26e919682d3 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:37.164366 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-25904715-a3f2-4e04-ae34-d26e919682d3 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:37.164847 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-25904715-a3f2-4e04-ae34-d26e919682d3 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:37.165353 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-25904715-a3f2-4e04-ae34-d26e919682d3 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:37.165811 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.objects.instance [None req-25904715-a3f2-4e04-ae34-d26e919682d3 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lazy-loading 'fault' on Instance uuid 1ffa9152-f022-466a-ab9b-9977066503d0 {{(pid=119659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:40:37.224427 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-25904715-a3f2-4e04-ae34-d26e919682d3 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8706e96002946b2b9bfe87de5c3271a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60403061fba42eba98a7c89987672a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:37.233808 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-25904715-a3f2-4e04-ae34-d26e919682d3 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] 10.222.0.30 "GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0" status: 200 len: 1305 microversion: 2.1 time: 0.132988 Nov 02 14:40:37.234525 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 77/153] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:37 2022] GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0 => generated 1305 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:37.782544 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-a406abe9-57b5-4363-87a1-3fb399d4b3fc tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:37.783238 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-a406abe9-57b5-4363-87a1-3fb399d4b3fc tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:37.789957 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a406abe9-57b5-4363-87a1-3fb399d4b3fc tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:37.790444 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a406abe9-57b5-4363-87a1-3fb399d4b3fc tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:37.790877 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a406abe9-57b5-4363-87a1-3fb399d4b3fc tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:37.791602 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a406abe9-57b5-4363-87a1-3fb399d4b3fc tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:37.792030 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a406abe9-57b5-4363-87a1-3fb399d4b3fc tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:37.792452 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a406abe9-57b5-4363-87a1-3fb399d4b3fc tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:37.936112 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-a406abe9-57b5-4363-87a1-3fb399d4b3fc tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:37.944201 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-a406abe9-57b5-4363-87a1-3fb399d4b3fc tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1523 microversion: 2.1 time: 0.166240 Nov 02 14:40:37.961175 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 77/154] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:37 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:38.261852 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-83a35179-f568-439a-a945-1c2e37fd4bee tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:38.263323 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-83a35179-f568-439a-a945-1c2e37fd4bee tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] [instance: 1ffa9152-f022-466a-ab9b-9977066503d0] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:38.271850 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-83a35179-f568-439a-a945-1c2e37fd4bee tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:38.271850 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-83a35179-f568-439a-a945-1c2e37fd4bee tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:38.271850 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-83a35179-f568-439a-a945-1c2e37fd4bee tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:38.271850 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-83a35179-f568-439a-a945-1c2e37fd4bee tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:38.272307 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-83a35179-f568-439a-a945-1c2e37fd4bee tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:38.272904 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-83a35179-f568-439a-a945-1c2e37fd4bee tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:38.286500 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.wsgi [None req-83a35179-f568-439a-a945-1c2e37fd4bee tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] HTTP exception thrown: Instance 1ffa9152-f022-466a-ab9b-9977066503d0 could not be found. Nov 02 14:40:38.291124 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-83a35179-f568-439a-a945-1c2e37fd4bee tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Request method failure captured: Nov 02 14:40:38.291124 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: request: GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0 HTTP/1.1 Nov 02 14:40:38.291124 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Accept: application/json Nov 02 14:40:38.291124 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Accept-Encoding: identity Nov 02 14:40:38.291124 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Connection: close Nov 02 14:40:38.291124 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Content-Length: 0 Nov 02 14:40:38.291124 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Content-Type: application/json Nov 02 14:40:38.291124 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Host: 10.222.0.30 Nov 02 14:40:38.291124 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Openstack-System-Scope: None Nov 02 14:40:38.291124 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: User-Agent: python-urllib3/1.26.12 Nov 02 14:40:38.291124 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Auth-Token: gAAAAABjYoEiTQdWL2RyRunQ6Z48Kmz2F7M4i98HdRLrQ1f54D411TmTS3HlQzA8KmAed8viftiPhq0kfCpLYIc-8j30NPVC5sIU-1cGXe0juIMP-JPEcQQVE6tKxQvrh3TZrMqswuJmFjDZ7pnuGpFrXGTwOXCyJl8uHO67zZzDycyWAaDbL2w Nov 02 14:40:38.291124 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Domain-Id: None Nov 02 14:40:38.291124 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Domain-Name: None Nov 02 14:40:38.291124 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Identity-Status: Confirmed Nov 02 14:40:38.291124 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Is-Admin-Project: True Nov 02 14:40:38.291124 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Domain-Id: default Nov 02 14:40:38.291124 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Domain-Name: Default Nov 02 14:40:38.291124 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Id: b60403061fba42eba98a7c89987672a8 Nov 02 14:40:38.291124 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Name: tempest-DeleteServersTestJSON-1346766697 Nov 02 14:40:38.291124 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Role: reader,member Nov 02 14:40:38.291124 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Roles: reader,member Nov 02 14:40:38.300953 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b60403061fba42eba98a7c89987672a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b60403061fba42eba98a7c89987672a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b60403061fba42eba98a7c89987672a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b60403061fba42eba98a7c89987672a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:40:38.300953 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant: tempest-DeleteServersTestJSON-1346766697 Nov 02 14:40:38.300953 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant-Id: b60403061fba42eba98a7c89987672a8 Nov 02 14:40:38.300953 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant-Name: tempest-DeleteServersTestJSON-1346766697 Nov 02 14:40:38.300953 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User: tempest-DeleteServersTestJSON-1346766697-project Nov 02 14:40:38.300953 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Domain-Id: default Nov 02 14:40:38.300953 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Domain-Name: Default Nov 02 14:40:38.300953 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Id: a8706e96002946b2b9bfe87de5c3271a Nov 02 14:40:38.300953 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Name: tempest-DeleteServersTestJSON-1346766697-project Nov 02 14:40:38.300953 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: method: > Nov 02 14:40:38.300953 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: exception: Instance 1ffa9152-f022-466a-ab9b-9977066503d0 could not be found. Nov 02 14:40:38.300953 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: action_args: {'id': '1ffa9152-f022-466a-ab9b-9977066503d0'} Nov 02 14:40:38.301762 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:40:38.301762 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:40:38.301762 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:40:38.301762 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:40:38.301762 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:40:38.301762 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:40:38.301762 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:40:38.301762 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:40:38.301762 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:40:38.301762 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:40:38.301762 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ffa9152-f022-466a-ab9b-9977066503d0 could not be found. Nov 02 14:40:38.301762 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:40:38.301762 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:40:38.301762 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:40:38.301762 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:40:38.301762 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:40:38.301762 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:40:38.301762 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:40:38.301762 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:40:38.301762 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:40:38.302853 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:40:38.302853 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:40:38.302853 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:40:38.302853 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:40:38.302853 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:40:38.302853 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:40:38.302853 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:40:38.302853 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ffa9152-f022-466a-ab9b-9977066503d0 could not be found. Nov 02 14:40:38.302853 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:40:38.302853 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:40:38.302853 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:40:38.302853 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:40:38.302853 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:40:38.302853 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:40:38.302853 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:40:38.302853 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:40:38.302853 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ffa9152-f022-466a-ab9b-9977066503d0 could not be found. Nov 02 14:40:38.302853 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:40:38.303841 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-83a35179-f568-439a-a945-1c2e37fd4bee tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Returning 404 to user: Instance 1ffa9152-f022-466a-ab9b-9977066503d0 could not be found. {{(pid=119659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:40:38.303841 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-83a35179-f568-439a-a945-1c2e37fd4bee tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] 10.222.0.30 "GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0" status: 404 len: 111 microversion: 2.1 time: 0.034906 Nov 02 14:40:38.303841 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 78/155] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:38 2022] GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:40:38.427948 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-73feb87e-549f-48d2-ae1c-e459455ec4a9 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:38.432945 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-73feb87e-549f-48d2-ae1c-e459455ec4a9 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] [instance: 1ffa9152-f022-466a-ab9b-9977066503d0] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:38.439689 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-73feb87e-549f-48d2-ae1c-e459455ec4a9 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:38.440172 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-73feb87e-549f-48d2-ae1c-e459455ec4a9 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:38.440597 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-73feb87e-549f-48d2-ae1c-e459455ec4a9 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:38.441603 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-73feb87e-549f-48d2-ae1c-e459455ec4a9 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:38.441801 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-73feb87e-549f-48d2-ae1c-e459455ec4a9 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:38.442185 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-73feb87e-549f-48d2-ae1c-e459455ec4a9 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:38.457055 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.wsgi [None req-73feb87e-549f-48d2-ae1c-e459455ec4a9 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] HTTP exception thrown: Instance 1ffa9152-f022-466a-ab9b-9977066503d0 could not be found. Nov 02 14:40:38.462254 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-73feb87e-549f-48d2-ae1c-e459455ec4a9 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Request method failure captured: Nov 02 14:40:38.462254 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: request: GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0/os-volume_attachments HTTP/1.1 Nov 02 14:40:38.462254 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Accept: application/json Nov 02 14:40:38.462254 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Accept-Encoding: identity Nov 02 14:40:38.462254 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Connection: close Nov 02 14:40:38.462254 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Content-Length: 0 Nov 02 14:40:38.462254 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Content-Type: application/json Nov 02 14:40:38.462254 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Host: 10.222.0.30 Nov 02 14:40:38.462254 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Openstack-System-Scope: None Nov 02 14:40:38.462254 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: User-Agent: python-urllib3/1.26.12 Nov 02 14:40:38.462254 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Auth-Token: gAAAAABjYoEiTQdWL2RyRunQ6Z48Kmz2F7M4i98HdRLrQ1f54D411TmTS3HlQzA8KmAed8viftiPhq0kfCpLYIc-8j30NPVC5sIU-1cGXe0juIMP-JPEcQQVE6tKxQvrh3TZrMqswuJmFjDZ7pnuGpFrXGTwOXCyJl8uHO67zZzDycyWAaDbL2w Nov 02 14:40:38.462254 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Domain-Id: None Nov 02 14:40:38.462254 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Domain-Name: None Nov 02 14:40:38.462254 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Identity-Status: Confirmed Nov 02 14:40:38.462254 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Is-Admin-Project: True Nov 02 14:40:38.462254 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Domain-Id: default Nov 02 14:40:38.462254 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Domain-Name: Default Nov 02 14:40:38.462254 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Id: b60403061fba42eba98a7c89987672a8 Nov 02 14:40:38.462254 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Name: tempest-DeleteServersTestJSON-1346766697 Nov 02 14:40:38.462254 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Role: reader,member Nov 02 14:40:38.462254 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Roles: reader,member Nov 02 14:40:38.463768 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b60403061fba42eba98a7c89987672a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b60403061fba42eba98a7c89987672a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b60403061fba42eba98a7c89987672a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b60403061fba42eba98a7c89987672a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:40:38.463768 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant: tempest-DeleteServersTestJSON-1346766697 Nov 02 14:40:38.463768 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant-Id: b60403061fba42eba98a7c89987672a8 Nov 02 14:40:38.463768 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant-Name: tempest-DeleteServersTestJSON-1346766697 Nov 02 14:40:38.463768 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User: tempest-DeleteServersTestJSON-1346766697-project Nov 02 14:40:38.463768 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Domain-Id: default Nov 02 14:40:38.463768 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Domain-Name: Default Nov 02 14:40:38.463768 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Id: a8706e96002946b2b9bfe87de5c3271a Nov 02 14:40:38.463768 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Name: tempest-DeleteServersTestJSON-1346766697-project Nov 02 14:40:38.463768 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: method: > Nov 02 14:40:38.463768 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: exception: Instance 1ffa9152-f022-466a-ab9b-9977066503d0 could not be found. Nov 02 14:40:38.463768 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: action_args: {'server_id': '1ffa9152-f022-466a-ab9b-9977066503d0'} Nov 02 14:40:38.464613 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:40:38.464613 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:40:38.464613 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:40:38.464613 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:40:38.464613 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:40:38.464613 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:40:38.464613 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:40:38.464613 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:40:38.464613 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:40:38.464613 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:40:38.464613 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ffa9152-f022-466a-ab9b-9977066503d0 could not be found. Nov 02 14:40:38.464613 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:40:38.464613 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:40:38.464613 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:40:38.464613 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:40:38.464613 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:40:38.464613 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:40:38.464613 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:40:38.464613 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:40:38.464613 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:40:38.466219 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:40:38.466219 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 14:40:38.466219 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:40:38.466219 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 14:40:38.466219 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:40:38.466219 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Nov 02 14:40:38.466219 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Nov 02 14:40:38.466219 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:40:38.466219 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:40:38.466219 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ffa9152-f022-466a-ab9b-9977066503d0 could not be found. Nov 02 14:40:38.466219 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:40:38.466219 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:40:38.466219 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:40:38.466219 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:40:38.466219 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:40:38.466219 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:40:38.466219 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:40:38.466219 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:40:38.466219 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ffa9152-f022-466a-ab9b-9977066503d0 could not be found. Nov 02 14:40:38.466219 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:40:38.468295 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-73feb87e-549f-48d2-ae1c-e459455ec4a9 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Returning 404 to user: Instance 1ffa9152-f022-466a-ab9b-9977066503d0 could not be found. {{(pid=119658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:40:38.468295 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-73feb87e-549f-48d2-ae1c-e459455ec4a9 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] 10.222.0.30 "GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.040076 Nov 02 14:40:38.468295 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 78/156] 10.222.0.30 () {58 vars in 1302 bytes} [Wed Nov 2 14:40:38 2022] GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0/os-volume_attachments => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:40:38.968656 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-cbddd0cc-fe94-4868-82f6-ad02bdc6333f tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:38.969592 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-cbddd0cc-fe94-4868-82f6-ad02bdc6333f tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:38.976634 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-cbddd0cc-fe94-4868-82f6-ad02bdc6333f tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:38.977146 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-cbddd0cc-fe94-4868-82f6-ad02bdc6333f tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:38.977597 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-cbddd0cc-fe94-4868-82f6-ad02bdc6333f tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:38.978588 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-cbddd0cc-fe94-4868-82f6-ad02bdc6333f tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:38.979039 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-cbddd0cc-fe94-4868-82f6-ad02bdc6333f tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:38.979459 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-cbddd0cc-fe94-4868-82f6-ad02bdc6333f tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:39.129205 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-cbddd0cc-fe94-4868-82f6-ad02bdc6333f tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:39.137492 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-cbddd0cc-fe94-4868-82f6-ad02bdc6333f tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1523 microversion: 2.1 time: 0.173502 Nov 02 14:40:39.138615 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 79/157] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:38 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:40.163642 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-acd317f9-eb96-4886-b26c-c94558d627eb tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:40.164276 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-acd317f9-eb96-4886-b26c-c94558d627eb tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:40.171151 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-acd317f9-eb96-4886-b26c-c94558d627eb tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:40.171662 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-acd317f9-eb96-4886-b26c-c94558d627eb tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:40.172263 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-acd317f9-eb96-4886-b26c-c94558d627eb tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:40.173154 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-acd317f9-eb96-4886-b26c-c94558d627eb tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:40.182066 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-acd317f9-eb96-4886-b26c-c94558d627eb tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:40.182516 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-acd317f9-eb96-4886-b26c-c94558d627eb tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:40.343069 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-acd317f9-eb96-4886-b26c-c94558d627eb tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:40.350778 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-acd317f9-eb96-4886-b26c-c94558d627eb tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1523 microversion: 2.1 time: 0.190993 Nov 02 14:40:40.351338 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 79/158] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:40 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1523 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:41.375181 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-2af073b1-123a-4fc6-99ad-554e2d60fc74 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:41.377263 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-2af073b1-123a-4fc6-99ad-554e2d60fc74 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:41.383256 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2af073b1-123a-4fc6-99ad-554e2d60fc74 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:41.383733 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2af073b1-123a-4fc6-99ad-554e2d60fc74 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:41.384326 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2af073b1-123a-4fc6-99ad-554e2d60fc74 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:41.385224 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2af073b1-123a-4fc6-99ad-554e2d60fc74 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:41.385813 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2af073b1-123a-4fc6-99ad-554e2d60fc74 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:41.386508 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2af073b1-123a-4fc6-99ad-554e2d60fc74 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:41.540506 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-2af073b1-123a-4fc6-99ad-554e2d60fc74 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:41.544295 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:40:41.549633 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-2af073b1-123a-4fc6-99ad-554e2d60fc74 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1523 microversion: 2.1 time: 0.178945 Nov 02 14:40:41.550627 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 80/159] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:41 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1523 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:42.577677 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-c50ad293-6596-4c38-a4e1-733ac19c4438 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:42.578451 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-c50ad293-6596-4c38-a4e1-733ac19c4438 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:42.588157 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c50ad293-6596-4c38-a4e1-733ac19c4438 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:42.588157 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c50ad293-6596-4c38-a4e1-733ac19c4438 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:42.588157 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c50ad293-6596-4c38-a4e1-733ac19c4438 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:42.588157 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c50ad293-6596-4c38-a4e1-733ac19c4438 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:42.588661 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c50ad293-6596-4c38-a4e1-733ac19c4438 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:42.589056 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c50ad293-6596-4c38-a4e1-733ac19c4438 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:42.771328 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-c50ad293-6596-4c38-a4e1-733ac19c4438 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:42.784789 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-c50ad293-6596-4c38-a4e1-733ac19c4438 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1523 microversion: 2.1 time: 0.214814 Nov 02 14:40:42.785387 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 80/160] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:42 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1523 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:43.117304 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-a0763240-e0ff-44ae-bafd-dff21cbe3ca5 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:43.117801 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-a0763240-e0ff-44ae-bafd-dff21cbe3ca5 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] [instance: 1ffa9152-f022-466a-ab9b-9977066503d0] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:43.127635 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a0763240-e0ff-44ae-bafd-dff21cbe3ca5 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:43.128795 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a0763240-e0ff-44ae-bafd-dff21cbe3ca5 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:43.129410 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a0763240-e0ff-44ae-bafd-dff21cbe3ca5 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:43.130640 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a0763240-e0ff-44ae-bafd-dff21cbe3ca5 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:43.131299 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a0763240-e0ff-44ae-bafd-dff21cbe3ca5 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:43.131869 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a0763240-e0ff-44ae-bafd-dff21cbe3ca5 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:43.148431 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.wsgi [None req-a0763240-e0ff-44ae-bafd-dff21cbe3ca5 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] HTTP exception thrown: Instance 1ffa9152-f022-466a-ab9b-9977066503d0 could not be found. Nov 02 14:40:43.151174 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-a0763240-e0ff-44ae-bafd-dff21cbe3ca5 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Request method failure captured: Nov 02 14:40:43.151174 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: request: DELETE /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0 HTTP/1.1 Nov 02 14:40:43.151174 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Accept: application/json Nov 02 14:40:43.151174 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Accept-Encoding: identity Nov 02 14:40:43.151174 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Connection: close Nov 02 14:40:43.151174 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Content-Length: 0 Nov 02 14:40:43.151174 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Content-Type: application/json Nov 02 14:40:43.151174 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Host: 10.222.0.30 Nov 02 14:40:43.151174 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Openstack-System-Scope: None Nov 02 14:40:43.151174 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: User-Agent: python-urllib3/1.26.12 Nov 02 14:40:43.151174 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Auth-Token: gAAAAABjYoEiTQdWL2RyRunQ6Z48Kmz2F7M4i98HdRLrQ1f54D411TmTS3HlQzA8KmAed8viftiPhq0kfCpLYIc-8j30NPVC5sIU-1cGXe0juIMP-JPEcQQVE6tKxQvrh3TZrMqswuJmFjDZ7pnuGpFrXGTwOXCyJl8uHO67zZzDycyWAaDbL2w Nov 02 14:40:43.151174 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Domain-Id: None Nov 02 14:40:43.151174 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Domain-Name: None Nov 02 14:40:43.151174 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Identity-Status: Confirmed Nov 02 14:40:43.151174 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Is-Admin-Project: True Nov 02 14:40:43.151174 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Domain-Id: default Nov 02 14:40:43.151174 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Domain-Name: Default Nov 02 14:40:43.151174 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Id: b60403061fba42eba98a7c89987672a8 Nov 02 14:40:43.151174 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Name: tempest-DeleteServersTestJSON-1346766697 Nov 02 14:40:43.151174 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Role: reader,member Nov 02 14:40:43.151174 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Roles: reader,member Nov 02 14:40:43.152640 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b60403061fba42eba98a7c89987672a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b60403061fba42eba98a7c89987672a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b60403061fba42eba98a7c89987672a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b60403061fba42eba98a7c89987672a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:40:43.152640 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant: tempest-DeleteServersTestJSON-1346766697 Nov 02 14:40:43.152640 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant-Id: b60403061fba42eba98a7c89987672a8 Nov 02 14:40:43.152640 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant-Name: tempest-DeleteServersTestJSON-1346766697 Nov 02 14:40:43.152640 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User: tempest-DeleteServersTestJSON-1346766697-project Nov 02 14:40:43.152640 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Domain-Id: default Nov 02 14:40:43.152640 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Domain-Name: Default Nov 02 14:40:43.152640 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Id: a8706e96002946b2b9bfe87de5c3271a Nov 02 14:40:43.152640 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Name: tempest-DeleteServersTestJSON-1346766697-project Nov 02 14:40:43.152640 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: method: > Nov 02 14:40:43.152640 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: exception: Instance 1ffa9152-f022-466a-ab9b-9977066503d0 could not be found. Nov 02 14:40:43.152640 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: action_args: {'id': '1ffa9152-f022-466a-ab9b-9977066503d0'} Nov 02 14:40:43.154832 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:40:43.154832 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:40:43.154832 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:40:43.154832 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:40:43.154832 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:40:43.154832 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:40:43.154832 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:40:43.154832 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:40:43.154832 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:40:43.154832 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:40:43.154832 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ffa9152-f022-466a-ab9b-9977066503d0 could not be found. Nov 02 14:40:43.154832 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:40:43.154832 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:40:43.154832 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:40:43.154832 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:40:43.154832 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:40:43.154832 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:40:43.154832 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:40:43.154832 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:40:43.154832 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:40:43.155903 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:40:43.155903 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:40:43.155903 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:40:43.155903 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:40:43.155903 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:40:43.155903 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:40:43.155903 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:40:43.155903 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:40:43.155903 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:40:43.155903 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ffa9152-f022-466a-ab9b-9977066503d0 could not be found. Nov 02 14:40:43.155903 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:40:43.155903 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:40:43.155903 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:40:43.155903 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:40:43.155903 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:40:43.155903 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:40:43.155903 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:40:43.155903 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:40:43.155903 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ffa9152-f022-466a-ab9b-9977066503d0 could not be found. Nov 02 14:40:43.155903 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:40:43.157967 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-a0763240-e0ff-44ae-bafd-dff21cbe3ca5 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Returning 404 to user: Instance 1ffa9152-f022-466a-ab9b-9977066503d0 could not be found. {{(pid=119659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:40:43.159334 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-a0763240-e0ff-44ae-bafd-dff21cbe3ca5 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0" status: 404 len: 111 microversion: 2.1 time: 0.045834 Nov 02 14:40:43.160405 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 81/161] 10.222.0.30 () {58 vars in 1239 bytes} [Wed Nov 2 14:40:43 2022] DELETE /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:40:43.170254 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-0619dfb6-4daf-4755-88c4-0770cd04cb81 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:43.171341 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-0619dfb6-4daf-4755-88c4-0770cd04cb81 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] [instance: 1ffa9152-f022-466a-ab9b-9977066503d0] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:43.178840 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0619dfb6-4daf-4755-88c4-0770cd04cb81 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:43.179322 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0619dfb6-4daf-4755-88c4-0770cd04cb81 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:43.181504 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0619dfb6-4daf-4755-88c4-0770cd04cb81 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:43.182530 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0619dfb6-4daf-4755-88c4-0770cd04cb81 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:43.185290 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0619dfb6-4daf-4755-88c4-0770cd04cb81 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:43.185950 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0619dfb6-4daf-4755-88c4-0770cd04cb81 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:43.205895 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.wsgi [None req-0619dfb6-4daf-4755-88c4-0770cd04cb81 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] HTTP exception thrown: Instance 1ffa9152-f022-466a-ab9b-9977066503d0 could not be found. Nov 02 14:40:43.208315 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-0619dfb6-4daf-4755-88c4-0770cd04cb81 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Request method failure captured: Nov 02 14:40:43.208315 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: request: GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0 HTTP/1.1 Nov 02 14:40:43.208315 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Accept: application/json Nov 02 14:40:43.208315 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Accept-Encoding: identity Nov 02 14:40:43.208315 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Connection: close Nov 02 14:40:43.208315 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Content-Length: 0 Nov 02 14:40:43.208315 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Content-Type: application/json Nov 02 14:40:43.208315 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Host: 10.222.0.30 Nov 02 14:40:43.208315 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Openstack-System-Scope: None Nov 02 14:40:43.208315 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: User-Agent: python-urllib3/1.26.12 Nov 02 14:40:43.208315 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Auth-Token: gAAAAABjYoEiTQdWL2RyRunQ6Z48Kmz2F7M4i98HdRLrQ1f54D411TmTS3HlQzA8KmAed8viftiPhq0kfCpLYIc-8j30NPVC5sIU-1cGXe0juIMP-JPEcQQVE6tKxQvrh3TZrMqswuJmFjDZ7pnuGpFrXGTwOXCyJl8uHO67zZzDycyWAaDbL2w Nov 02 14:40:43.208315 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Domain-Id: None Nov 02 14:40:43.208315 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Domain-Name: None Nov 02 14:40:43.208315 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Identity-Status: Confirmed Nov 02 14:40:43.208315 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Is-Admin-Project: True Nov 02 14:40:43.208315 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Domain-Id: default Nov 02 14:40:43.208315 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Domain-Name: Default Nov 02 14:40:43.208315 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Id: b60403061fba42eba98a7c89987672a8 Nov 02 14:40:43.208315 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Name: tempest-DeleteServersTestJSON-1346766697 Nov 02 14:40:43.208315 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Role: reader,member Nov 02 14:40:43.208315 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Roles: reader,member Nov 02 14:40:43.209761 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b60403061fba42eba98a7c89987672a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b60403061fba42eba98a7c89987672a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b60403061fba42eba98a7c89987672a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b60403061fba42eba98a7c89987672a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:40:43.209761 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant: tempest-DeleteServersTestJSON-1346766697 Nov 02 14:40:43.209761 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant-Id: b60403061fba42eba98a7c89987672a8 Nov 02 14:40:43.209761 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant-Name: tempest-DeleteServersTestJSON-1346766697 Nov 02 14:40:43.209761 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User: tempest-DeleteServersTestJSON-1346766697-project Nov 02 14:40:43.209761 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Domain-Id: default Nov 02 14:40:43.209761 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Domain-Name: Default Nov 02 14:40:43.209761 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Id: a8706e96002946b2b9bfe87de5c3271a Nov 02 14:40:43.209761 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Name: tempest-DeleteServersTestJSON-1346766697-project Nov 02 14:40:43.209761 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: method: > Nov 02 14:40:43.209761 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: exception: Instance 1ffa9152-f022-466a-ab9b-9977066503d0 could not be found. Nov 02 14:40:43.209761 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: action_args: {'id': '1ffa9152-f022-466a-ab9b-9977066503d0'} Nov 02 14:40:43.210721 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:40:43.210721 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:40:43.210721 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:40:43.210721 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:40:43.210721 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:40:43.210721 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:40:43.210721 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:40:43.210721 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:40:43.210721 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:40:43.210721 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:40:43.210721 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ffa9152-f022-466a-ab9b-9977066503d0 could not be found. Nov 02 14:40:43.210721 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:40:43.210721 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:40:43.210721 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:40:43.210721 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:40:43.210721 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:40:43.210721 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:40:43.210721 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:40:43.210721 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:40:43.210721 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:40:43.212406 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:40:43.212406 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:40:43.212406 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:40:43.212406 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:40:43.212406 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:40:43.212406 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:40:43.212406 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:40:43.212406 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ffa9152-f022-466a-ab9b-9977066503d0 could not be found. Nov 02 14:40:43.212406 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:40:43.212406 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:40:43.212406 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:40:43.212406 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:40:43.212406 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:40:43.212406 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:40:43.212406 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:40:43.212406 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:40:43.212406 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ffa9152-f022-466a-ab9b-9977066503d0 could not be found. Nov 02 14:40:43.212406 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:40:43.217042 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-0619dfb6-4daf-4755-88c4-0770cd04cb81 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] Returning 404 to user: Instance 1ffa9152-f022-466a-ab9b-9977066503d0 could not be found. {{(pid=119658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:40:43.217042 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-0619dfb6-4daf-4755-88c4-0770cd04cb81 tempest-DeleteServersTestJSON-1346766697 tempest-DeleteServersTestJSON-1346766697-project] 10.222.0.30 "GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0" status: 404 len: 111 microversion: 2.1 time: 0.044926 Nov 02 14:40:43.217042 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 81/162] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:43 2022] GET /compute/v2.1/servers/1ffa9152-f022-466a-ab9b-9977066503d0 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:40:43.808953 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-ca20e120-20e2-45f8-84d8-ab7bb1835ffa tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:43.810332 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-ca20e120-20e2-45f8-84d8-ab7bb1835ffa tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:43.817558 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ca20e120-20e2-45f8-84d8-ab7bb1835ffa tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:43.818048 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ca20e120-20e2-45f8-84d8-ab7bb1835ffa tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:43.818490 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ca20e120-20e2-45f8-84d8-ab7bb1835ffa tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:43.819191 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ca20e120-20e2-45f8-84d8-ab7bb1835ffa tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:43.819644 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ca20e120-20e2-45f8-84d8-ab7bb1835ffa tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:43.820063 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ca20e120-20e2-45f8-84d8-ab7bb1835ffa tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:43.959213 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-ca20e120-20e2-45f8-84d8-ab7bb1835ffa tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:43.969272 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-ca20e120-20e2-45f8-84d8-ab7bb1835ffa tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1523 microversion: 2.1 time: 0.164227 Nov 02 14:40:43.981707 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 82/163] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:43 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:40:44.997697 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-f088e7e2-1256-4f28-8b50-d8fef50c80e9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:44.998315 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-f088e7e2-1256-4f28-8b50-d8fef50c80e9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:45.005797 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f088e7e2-1256-4f28-8b50-d8fef50c80e9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:45.008909 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f088e7e2-1256-4f28-8b50-d8fef50c80e9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:45.008909 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f088e7e2-1256-4f28-8b50-d8fef50c80e9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:45.008909 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f088e7e2-1256-4f28-8b50-d8fef50c80e9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:45.008909 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f088e7e2-1256-4f28-8b50-d8fef50c80e9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:45.009308 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f088e7e2-1256-4f28-8b50-d8fef50c80e9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:45.282202 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-f088e7e2-1256-4f28-8b50-d8fef50c80e9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:45.288305 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-f088e7e2-1256-4f28-8b50-d8fef50c80e9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1523 microversion: 2.1 time: 0.294533 Nov 02 14:40:45.288897 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 82/164] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:44 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1523 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:46.313923 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-6e64559e-d1ae-4645-a95f-39fa45295520 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:46.314709 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-6e64559e-d1ae-4645-a95f-39fa45295520 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:46.323476 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6e64559e-d1ae-4645-a95f-39fa45295520 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:46.324062 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6e64559e-d1ae-4645-a95f-39fa45295520 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:46.324720 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6e64559e-d1ae-4645-a95f-39fa45295520 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:46.325917 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6e64559e-d1ae-4645-a95f-39fa45295520 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:46.326746 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6e64559e-d1ae-4645-a95f-39fa45295520 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:46.327392 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6e64559e-d1ae-4645-a95f-39fa45295520 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:46.576477 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-6e64559e-d1ae-4645-a95f-39fa45295520 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:46.585197 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-6e64559e-d1ae-4645-a95f-39fa45295520 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1523 microversion: 2.1 time: 0.276877 Nov 02 14:40:46.588299 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 83/165] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:46 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1523 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:47.616259 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-1c2c6f2a-9f31-44d3-bd4c-1e92702158cf tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:47.616863 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-1c2c6f2a-9f31-44d3-bd4c-1e92702158cf tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:47.625450 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1c2c6f2a-9f31-44d3-bd4c-1e92702158cf tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:47.626580 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1c2c6f2a-9f31-44d3-bd4c-1e92702158cf tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:47.627192 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1c2c6f2a-9f31-44d3-bd4c-1e92702158cf tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:47.628159 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1c2c6f2a-9f31-44d3-bd4c-1e92702158cf tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:47.628829 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1c2c6f2a-9f31-44d3-bd4c-1e92702158cf tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:47.629472 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1c2c6f2a-9f31-44d3-bd4c-1e92702158cf tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:47.884519 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-1c2c6f2a-9f31-44d3-bd4c-1e92702158cf tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:47.901256 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-1c2c6f2a-9f31-44d3-bd4c-1e92702158cf tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1523 microversion: 2.1 time: 0.289732 Nov 02 14:40:47.902624 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 83/166] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:47 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1523 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:48.926179 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-387c8d3a-acf2-4127-a05d-154c26dfc8c6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:48.926984 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-387c8d3a-acf2-4127-a05d-154c26dfc8c6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:48.935001 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-387c8d3a-acf2-4127-a05d-154c26dfc8c6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:48.935635 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-387c8d3a-acf2-4127-a05d-154c26dfc8c6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:48.936628 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-387c8d3a-acf2-4127-a05d-154c26dfc8c6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:48.937367 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-387c8d3a-acf2-4127-a05d-154c26dfc8c6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:48.937821 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-387c8d3a-acf2-4127-a05d-154c26dfc8c6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:48.938244 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-387c8d3a-acf2-4127-a05d-154c26dfc8c6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:49.116391 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-387c8d3a-acf2-4127-a05d-154c26dfc8c6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:49.125654 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-387c8d3a-acf2-4127-a05d-154c26dfc8c6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1523 microversion: 2.1 time: 0.203804 Nov 02 14:40:49.126227 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 84/167] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:48 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1523 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:50.149471 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-98bb0de6-5b4e-4617-b202-00fc7b803dd7 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:50.150084 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-98bb0de6-5b4e-4617-b202-00fc7b803dd7 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:50.157638 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-98bb0de6-5b4e-4617-b202-00fc7b803dd7 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:50.158125 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-98bb0de6-5b4e-4617-b202-00fc7b803dd7 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:50.158617 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-98bb0de6-5b4e-4617-b202-00fc7b803dd7 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:50.159306 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-98bb0de6-5b4e-4617-b202-00fc7b803dd7 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:50.159748 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-98bb0de6-5b4e-4617-b202-00fc7b803dd7 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:50.160222 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-98bb0de6-5b4e-4617-b202-00fc7b803dd7 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:50.302770 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-98bb0de6-5b4e-4617-b202-00fc7b803dd7 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:50.314014 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-98bb0de6-5b4e-4617-b202-00fc7b803dd7 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1523 microversion: 2.1 time: 0.165337 Nov 02 14:40:50.314014 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 84/168] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:50 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:51.333744 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-ac81d898-dc2b-4536-b393-3911a2ed4b04 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:51.334356 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-ac81d898-dc2b-4536-b393-3911a2ed4b04 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:51.340897 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ac81d898-dc2b-4536-b393-3911a2ed4b04 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:51.341565 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ac81d898-dc2b-4536-b393-3911a2ed4b04 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:51.342024 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ac81d898-dc2b-4536-b393-3911a2ed4b04 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:51.342728 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ac81d898-dc2b-4536-b393-3911a2ed4b04 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:51.343285 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ac81d898-dc2b-4536-b393-3911a2ed4b04 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:51.343714 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ac81d898-dc2b-4536-b393-3911a2ed4b04 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:51.486515 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-ac81d898-dc2b-4536-b393-3911a2ed4b04 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:51.499376 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-ac81d898-dc2b-4536-b393-3911a2ed4b04 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1523 microversion: 2.1 time: 0.169395 Nov 02 14:40:51.499953 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 85/169] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:51 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:51.690113 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-ed456783-4816-44eb-bf4a-80b203f541f0 tempest-VolumesSnapshotsTestJSON-1170943817 tempest-VolumesSnapshotsTestJSON-1170943817-project] Action: 'create', calling method: .version_select at 0x7fb24f023280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1221263889"}} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:40:52.488819 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-ed456783-4816-44eb-bf4a-80b203f541f0 tempest-VolumesSnapshotsTestJSON-1170943817 tempest-VolumesSnapshotsTestJSON-1170943817-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.999098 Nov 02 14:40:52.489485 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 85/170] 10.222.0.30 () {60 vars in 1155 bytes} [Wed Nov 2 14:40:51 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1000 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Nov 02 14:40:52.504113 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-55c3e2ec-b9af-4d58-9825-2ffee16ee54a tempest-VolumesSnapshotsTestJSON-1170943817 tempest-VolumesSnapshotsTestJSON-1170943817-project] Calling method '.version_select at 0x7fb24ef90ca0>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:52.527571 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-3ece1900-fa34-4256-bb0e-e196d9f8e2f8 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:52.528519 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-3ece1900-fa34-4256-bb0e-e196d9f8e2f8 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:52.538646 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3ece1900-fa34-4256-bb0e-e196d9f8e2f8 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:52.539138 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3ece1900-fa34-4256-bb0e-e196d9f8e2f8 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:52.539595 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3ece1900-fa34-4256-bb0e-e196d9f8e2f8 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:52.540309 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3ece1900-fa34-4256-bb0e-e196d9f8e2f8 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:52.540763 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3ece1900-fa34-4256-bb0e-e196d9f8e2f8 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:52.541215 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3ece1900-fa34-4256-bb0e-e196d9f8e2f8 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:52.575445 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-55c3e2ec-b9af-4d58-9825-2ffee16ee54a tempest-VolumesSnapshotsTestJSON-1170943817 tempest-VolumesSnapshotsTestJSON-1170943817-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/e7b17b32-6ada-4a84-9b8f-7743f77c2387" status: 200 len: 345 microversion: 2.1 time: 0.074699 Nov 02 14:40:52.576206 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 86/171] 10.222.0.30 () {58 vars in 1245 bytes} [Wed Nov 2 14:40:52 2022] GET /compute/v2.1/os-volumes/e7b17b32-6ada-4a84-9b8f-7743f77c2387 => generated 345 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:40:52.709718 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-3ece1900-fa34-4256-bb0e-e196d9f8e2f8 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:52.720919 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-3ece1900-fa34-4256-bb0e-e196d9f8e2f8 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1523 microversion: 2.1 time: 0.196340 Nov 02 14:40:52.722002 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 86/172] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:52 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1523 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:53.591471 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-96681401-9e6f-48fd-afd8-6bfba51e9e4c tempest-VolumesSnapshotsTestJSON-1170943817 tempest-VolumesSnapshotsTestJSON-1170943817-project] Calling method '.version_select at 0x7fb24f0f91f0>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:53.648411 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-96681401-9e6f-48fd-afd8-6bfba51e9e4c tempest-VolumesSnapshotsTestJSON-1170943817 tempest-VolumesSnapshotsTestJSON-1170943817-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/e7b17b32-6ada-4a84-9b8f-7743f77c2387" status: 200 len: 346 microversion: 2.1 time: 0.061918 Nov 02 14:40:53.649041 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 87/173] 10.222.0.30 () {58 vars in 1245 bytes} [Wed Nov 2 14:40:53 2022] GET /compute/v2.1/os-volumes/e7b17b32-6ada-4a84-9b8f-7743f77c2387 => generated 346 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:40:53.672381 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-49726e65-41dc-4ea5-918e-874e357d27f5 tempest-VolumesSnapshotsTestJSON-1170943817 tempest-VolumesSnapshotsTestJSON-1170943817-project] Action: 'create', calling method: .version_select at 0x7fb24f023ee0>, body: {"snapshot": {"volume_id": "e7b17b32-6ada-4a84-9b8f-7743f77c2387", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1149782085"}} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:40:53.746446 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-045c4f5a-fc43-45ec-8669-3ff9bc349762 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:53.747332 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-045c4f5a-fc43-45ec-8669-3ff9bc349762 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:53.754130 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-045c4f5a-fc43-45ec-8669-3ff9bc349762 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:53.754677 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-045c4f5a-fc43-45ec-8669-3ff9bc349762 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:53.755175 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-045c4f5a-fc43-45ec-8669-3ff9bc349762 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:53.755929 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-045c4f5a-fc43-45ec-8669-3ff9bc349762 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:53.756441 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-045c4f5a-fc43-45ec-8669-3ff9bc349762 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:53.756970 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-045c4f5a-fc43-45ec-8669-3ff9bc349762 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:53.895515 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-045c4f5a-fc43-45ec-8669-3ff9bc349762 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:53.904162 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-045c4f5a-fc43-45ec-8669-3ff9bc349762 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1523 microversion: 2.1 time: 0.161342 Nov 02 14:40:53.904919 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 88/174] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:53 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:40:54.043517 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-49726e65-41dc-4ea5-918e-874e357d27f5 tempest-VolumesSnapshotsTestJSON-1170943817 tempest-VolumesSnapshotsTestJSON-1170943817-project] 10.222.0.30 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.380074 Nov 02 14:40:54.045385 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 87/175] 10.222.0.30 () {60 vars in 1162 bytes} [Wed Nov 2 14:40:53 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:40:54.055765 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-efa72f37-3f5d-4332-b4aa-56432d554377 tempest-VolumesSnapshotsTestJSON-1170943817 tempest-VolumesSnapshotsTestJSON-1170943817-project] Calling method '.version_select at 0x7fb24f0f9700>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:54.086122 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-efa72f37-3f5d-4332-b4aa-56432d554377 tempest-VolumesSnapshotsTestJSON-1170943817 tempest-VolumesSnapshotsTestJSON-1170943817-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/d5e69888-c4bc-46e2-83c4-64d0fbace992" status: 200 len: 287 microversion: 2.1 time: 0.034062 Nov 02 14:40:54.086695 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 89/176] 10.222.0.30 () {58 vars in 1251 bytes} [Wed Nov 2 14:40:54 2022] GET /compute/v2.1/os-snapshots/d5e69888-c4bc-46e2-83c4-64d0fbace992 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:40:54.098369 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-5fca5d3b-2a0c-41fd-bc2b-ac0144503ebe tempest-VolumesSnapshotsTestJSON-1170943817 tempest-VolumesSnapshotsTestJSON-1170943817-project] Calling method '.version_select at 0x7fb24f0208b0>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:54.128449 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-5fca5d3b-2a0c-41fd-bc2b-ac0144503ebe tempest-VolumesSnapshotsTestJSON-1170943817 tempest-VolumesSnapshotsTestJSON-1170943817-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.033817 Nov 02 14:40:54.129023 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 88/177] 10.222.0.30 () {58 vars in 1140 bytes} [Wed Nov 2 14:40:54 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:40:54.140806 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-3188a103-6b16-40be-879c-87193f26fe8a tempest-VolumesSnapshotsTestJSON-1170943817 tempest-VolumesSnapshotsTestJSON-1170943817-project] Calling method '.version_select at 0x7fb24ef903a0>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:54.174005 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-3188a103-6b16-40be-879c-87193f26fe8a tempest-VolumesSnapshotsTestJSON-1170943817 tempest-VolumesSnapshotsTestJSON-1170943817-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/d5e69888-c4bc-46e2-83c4-64d0fbace992" status: 200 len: 287 microversion: 2.1 time: 0.037147 Nov 02 14:40:54.174579 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 90/178] 10.222.0.30 () {58 vars in 1251 bytes} [Wed Nov 2 14:40:54 2022] GET /compute/v2.1/os-snapshots/d5e69888-c4bc-46e2-83c4-64d0fbace992 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:40:54.927619 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-d706526a-3ede-486b-884e-50394dc41411 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:54.928231 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-d706526a-3ede-486b-884e-50394dc41411 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:54.935053 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d706526a-3ede-486b-884e-50394dc41411 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:54.936115 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d706526a-3ede-486b-884e-50394dc41411 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:54.936590 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d706526a-3ede-486b-884e-50394dc41411 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:54.937306 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d706526a-3ede-486b-884e-50394dc41411 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:54.937799 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d706526a-3ede-486b-884e-50394dc41411 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:54.938233 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d706526a-3ede-486b-884e-50394dc41411 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:55.073607 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-d706526a-3ede-486b-884e-50394dc41411 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:55.078474 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell1:SELECT=100 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:40:55.083428 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-d706526a-3ede-486b-884e-50394dc41411 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1503 microversion: 2.1 time: 0.159785 Nov 02 14:40:55.084042 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 89/179] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:54 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:55.112093 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-1630e1f3-26e1-4427-a538-8c714e6927ff tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:55.112714 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-1630e1f3-26e1-4427-a538-8c714e6927ff tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 803e6b19-d962-4158-9a6c-e38cbd2b3e04] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:55.120798 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1630e1f3-26e1-4427-a538-8c714e6927ff tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:55.125184 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1630e1f3-26e1-4427-a538-8c714e6927ff tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:55.125184 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1630e1f3-26e1-4427-a538-8c714e6927ff tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:55.125184 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1630e1f3-26e1-4427-a538-8c714e6927ff tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:55.125184 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1630e1f3-26e1-4427-a538-8c714e6927ff tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:55.125646 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1630e1f3-26e1-4427-a538-8c714e6927ff tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:55.195441 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-d67f15c3-477d-46e2-9f9f-28e5251efe55 tempest-VolumesSnapshotsTestJSON-1170943817 tempest-VolumesSnapshotsTestJSON-1170943817-project] Calling method '.version_select at 0x7fb24f023d30>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:55.231271 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-d67f15c3-477d-46e2-9f9f-28e5251efe55 tempest-VolumesSnapshotsTestJSON-1170943817 tempest-VolumesSnapshotsTestJSON-1170943817-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/d5e69888-c4bc-46e2-83c4-64d0fbace992" status: 200 len: 287 microversion: 2.1 time: 0.039576 Nov 02 14:40:55.231922 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 90/180] 10.222.0.30 () {58 vars in 1251 bytes} [Wed Nov 2 14:40:55 2022] GET /compute/v2.1/os-snapshots/d5e69888-c4bc-46e2-83c4-64d0fbace992 => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:40:55.266388 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-1630e1f3-26e1-4427-a538-8c714e6927ff tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:55.274059 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-1630e1f3-26e1-4427-a538-8c714e6927ff tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04" status: 200 len: 1517 microversion: 2.1 time: 0.167939 Nov 02 14:40:55.274639 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 91/181] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:55 2022] GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04 => generated 1517 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:56.244233 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-d60206c5-f40f-43ae-ad49-2ee008fa7f16 tempest-VolumesSnapshotsTestJSON-1170943817 tempest-VolumesSnapshotsTestJSON-1170943817-project] Calling method '.version_select at 0x7fb24f2d78b0>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:56.277907 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-d60206c5-f40f-43ae-ad49-2ee008fa7f16 tempest-VolumesSnapshotsTestJSON-1170943817 tempest-VolumesSnapshotsTestJSON-1170943817-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/d5e69888-c4bc-46e2-83c4-64d0fbace992" status: 200 len: 287 microversion: 2.1 time: 0.037219 Nov 02 14:40:56.278480 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 91/182] 10.222.0.30 () {58 vars in 1251 bytes} [Wed Nov 2 14:40:56 2022] GET /compute/v2.1/os-snapshots/d5e69888-c4bc-46e2-83c4-64d0fbace992 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:40:57.295772 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-cd86a51e-c4c9-4e7b-980e-7605f62ea3d9 tempest-VolumesSnapshotsTestJSON-1170943817 tempest-VolumesSnapshotsTestJSON-1170943817-project] Calling method '.version_select at 0x7fb24f23e280>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:57.326789 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-cd86a51e-c4c9-4e7b-980e-7605f62ea3d9 tempest-VolumesSnapshotsTestJSON-1170943817 tempest-VolumesSnapshotsTestJSON-1170943817-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/d5e69888-c4bc-46e2-83c4-64d0fbace992" status: 200 len: 287 microversion: 2.1 time: 0.035819 Nov 02 14:40:57.327314 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 92/183] 10.222.0.30 () {58 vars in 1251 bytes} [Wed Nov 2 14:40:57 2022] GET /compute/v2.1/os-snapshots/d5e69888-c4bc-46e2-83c4-64d0fbace992 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:40:58.244720 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-6cc7e81a-652b-4d68-9b24-7ede94c7449a tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:40:58.247048 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-6cc7e81a-652b-4d68-9b24-7ede94c7449a tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 803e6b19-d962-4158-9a6c-e38cbd2b3e04] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:58.254284 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6cc7e81a-652b-4d68-9b24-7ede94c7449a tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:58.254760 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6cc7e81a-652b-4d68-9b24-7ede94c7449a tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:58.255190 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6cc7e81a-652b-4d68-9b24-7ede94c7449a tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:58.255886 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6cc7e81a-652b-4d68-9b24-7ede94c7449a tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:58.256334 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6cc7e81a-652b-4d68-9b24-7ede94c7449a tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:58.256755 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6cc7e81a-652b-4d68-9b24-7ede94c7449a tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:58.282013 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.objects.instance [None req-6cc7e81a-652b-4d68-9b24-7ede94c7449a tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lazy-loading 'flavor' on Instance uuid 803e6b19-d962-4158-9a6c-e38cbd2b3e04 {{(pid=119658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:40:58.340302 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-80ca0b8c-69e8-4453-8563-c6ce552ea24b tempest-VolumesSnapshotsTestJSON-1170943817 tempest-VolumesSnapshotsTestJSON-1170943817-project] Calling method '.version_select at 0x7fb24efa8a60>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:58.371740 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-80ca0b8c-69e8-4453-8563-c6ce552ea24b tempest-VolumesSnapshotsTestJSON-1170943817 tempest-VolumesSnapshotsTestJSON-1170943817-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/d5e69888-c4bc-46e2-83c4-64d0fbace992" status: 200 len: 288 microversion: 2.1 time: 0.036112 Nov 02 14:40:58.372338 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 93/184] 10.222.0.30 () {58 vars in 1251 bytes} [Wed Nov 2 14:40:58 2022] GET /compute/v2.1/os-snapshots/d5e69888-c4bc-46e2-83c4-64d0fbace992 => generated 288 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:40:58.384700 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-ac2e4983-c460-4c8d-981d-ff48f9cbea52 tempest-VolumesSnapshotsTestJSON-1170943817 tempest-VolumesSnapshotsTestJSON-1170943817-project] Calling method '.version_select at 0x7fb24efa8f70>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:58.549471 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-ac2e4983-c460-4c8d-981d-ff48f9cbea52 tempest-VolumesSnapshotsTestJSON-1170943817 tempest-VolumesSnapshotsTestJSON-1170943817-project] 10.222.0.30 "DELETE /compute/v2.1/os-snapshots/d5e69888-c4bc-46e2-83c4-64d0fbace992" status: 202 len: 0 microversion: 2.1 time: 0.167138 Nov 02 14:40:58.549471 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 94/185] 10.222.0.30 () {58 vars in 1254 bytes} [Wed Nov 2 14:40:58 2022] DELETE /compute/v2.1/os-snapshots/d5e69888-c4bc-46e2-83c4-64d0fbace992 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 14:40:58.556752 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-40f53dd4-7a8a-43fd-916c-232b475b72b1 tempest-VolumesSnapshotsTestJSON-1170943817 tempest-VolumesSnapshotsTestJSON-1170943817-project] Calling method '.version_select at 0x7fb24efa85e0>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:58.586876 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-40f53dd4-7a8a-43fd-916c-232b475b72b1 tempest-VolumesSnapshotsTestJSON-1170943817 tempest-VolumesSnapshotsTestJSON-1170943817-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/d5e69888-c4bc-46e2-83c4-64d0fbace992" status: 200 len: 287 microversion: 2.1 time: 0.034052 Nov 02 14:40:58.587446 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 95/186] 10.222.0.30 () {58 vars in 1251 bytes} [Wed Nov 2 14:40:58 2022] GET /compute/v2.1/os-snapshots/d5e69888-c4bc-46e2-83c4-64d0fbace992 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:40:58.597390 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-6cc7e81a-652b-4d68-9b24-7ede94c7449a tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "POST /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04/action" status: 200 len: 32 microversion: 2.1 time: 0.356756 Nov 02 14:40:58.598474 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 92/187] 10.222.0.30 () {60 vars in 1278 bytes} [Wed Nov 2 14:40:58 2022] POST /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04/action => generated 32 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 14:40:58.608937 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-44c23f0c-9662-4b6e-b475-34e0916e4629 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:58.609563 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-44c23f0c-9662-4b6e-b475-34e0916e4629 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 803e6b19-d962-4158-9a6c-e38cbd2b3e04] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:58.615976 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-44c23f0c-9662-4b6e-b475-34e0916e4629 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:58.617864 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-44c23f0c-9662-4b6e-b475-34e0916e4629 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:58.617864 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-44c23f0c-9662-4b6e-b475-34e0916e4629 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:58.617864 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-44c23f0c-9662-4b6e-b475-34e0916e4629 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:58.618181 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-44c23f0c-9662-4b6e-b475-34e0916e4629 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:58.618391 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-44c23f0c-9662-4b6e-b475-34e0916e4629 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:58.762485 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-44c23f0c-9662-4b6e-b475-34e0916e4629 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:58.770807 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-44c23f0c-9662-4b6e-b475-34e0916e4629 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04" status: 200 len: 1523 microversion: 2.1 time: 0.166793 Nov 02 14:40:58.771378 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 96/188] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:58 2022] GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:59.600161 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-e85c6643-3a08-4010-b6a8-10b4e384458d tempest-VolumesSnapshotsTestJSON-1170943817 tempest-VolumesSnapshotsTestJSON-1170943817-project] Calling method '.version_select at 0x7fb24f020a60>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:59.631784 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-e85c6643-3a08-4010-b6a8-10b4e384458d tempest-VolumesSnapshotsTestJSON-1170943817 tempest-VolumesSnapshotsTestJSON-1170943817-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/d5e69888-c4bc-46e2-83c4-64d0fbace992" status: 200 len: 287 microversion: 2.1 time: 0.035689 Nov 02 14:40:59.632358 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 93/189] 10.222.0.30 () {58 vars in 1251 bytes} [Wed Nov 2 14:40:59 2022] GET /compute/v2.1/os-snapshots/d5e69888-c4bc-46e2-83c4-64d0fbace992 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:40:59.795635 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-e9b99c4c-535d-4ed4-be24-d5f3a9ea2114 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:59.796236 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-e9b99c4c-535d-4ed4-be24-d5f3a9ea2114 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 803e6b19-d962-4158-9a6c-e38cbd2b3e04] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:59.802706 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e9b99c4c-535d-4ed4-be24-d5f3a9ea2114 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:59.803181 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e9b99c4c-535d-4ed4-be24-d5f3a9ea2114 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:59.803611 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e9b99c4c-535d-4ed4-be24-d5f3a9ea2114 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:59.804314 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e9b99c4c-535d-4ed4-be24-d5f3a9ea2114 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:59.804800 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e9b99c4c-535d-4ed4-be24-d5f3a9ea2114 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:59.805246 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e9b99c4c-535d-4ed4-be24-d5f3a9ea2114 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:59.936060 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-e9b99c4c-535d-4ed4-be24-d5f3a9ea2114 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:59.943610 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-e9b99c4c-535d-4ed4-be24-d5f3a9ea2114 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04" status: 200 len: 1523 microversion: 2.1 time: 0.152235 Nov 02 14:40:59.944167 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 97/190] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:59 2022] GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:00.644059 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-88788a8f-eeab-4224-b8be-22004d1f56dd tempest-VolumesSnapshotsTestJSON-1170943817 tempest-VolumesSnapshotsTestJSON-1170943817-project] Calling method '.version_select at 0x7fb24f020ee0>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:00.675707 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-88788a8f-eeab-4224-b8be-22004d1f56dd tempest-VolumesSnapshotsTestJSON-1170943817 tempest-VolumesSnapshotsTestJSON-1170943817-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/d5e69888-c4bc-46e2-83c4-64d0fbace992" status: 200 len: 287 microversion: 2.1 time: 0.035396 Nov 02 14:41:00.676274 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 94/191] 10.222.0.30 () {58 vars in 1251 bytes} [Wed Nov 2 14:41:00 2022] GET /compute/v2.1/os-snapshots/d5e69888-c4bc-46e2-83c4-64d0fbace992 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:41:00.968375 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-f08692c3-6a8b-4d8a-b6b7-8ef7f3d46970 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:00.968995 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-f08692c3-6a8b-4d8a-b6b7-8ef7f3d46970 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 803e6b19-d962-4158-9a6c-e38cbd2b3e04] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:00.976169 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f08692c3-6a8b-4d8a-b6b7-8ef7f3d46970 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:00.976669 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f08692c3-6a8b-4d8a-b6b7-8ef7f3d46970 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:00.977118 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f08692c3-6a8b-4d8a-b6b7-8ef7f3d46970 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:00.977894 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f08692c3-6a8b-4d8a-b6b7-8ef7f3d46970 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:00.978604 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f08692c3-6a8b-4d8a-b6b7-8ef7f3d46970 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:00.979263 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f08692c3-6a8b-4d8a-b6b7-8ef7f3d46970 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:01.205766 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-f08692c3-6a8b-4d8a-b6b7-8ef7f3d46970 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:01.213637 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-f08692c3-6a8b-4d8a-b6b7-8ef7f3d46970 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04" status: 200 len: 1523 microversion: 2.1 time: 0.249836 Nov 02 14:41:01.214208 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 98/192] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:00 2022] GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04 => generated 1523 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:41:01.689228 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-1dc41cdf-0215-4f0c-9a54-807d9fd20e42 tempest-VolumesSnapshotsTestJSON-1170943817 tempest-VolumesSnapshotsTestJSON-1170943817-project] Calling method '.version_select at 0x7fb24f023430>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:01.725790 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-1dc41cdf-0215-4f0c-9a54-807d9fd20e42 tempest-VolumesSnapshotsTestJSON-1170943817 tempest-VolumesSnapshotsTestJSON-1170943817-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/d5e69888-c4bc-46e2-83c4-64d0fbace992" status: 200 len: 287 microversion: 2.1 time: 0.041635 Nov 02 14:41:01.727675 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 95/193] 10.222.0.30 () {58 vars in 1251 bytes} [Wed Nov 2 14:41:01 2022] GET /compute/v2.1/os-snapshots/d5e69888-c4bc-46e2-83c4-64d0fbace992 => generated 287 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:41:02.238986 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-164b27ea-48ae-4f76-b48b-42351233f15d tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:02.239685 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-164b27ea-48ae-4f76-b48b-42351233f15d tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 803e6b19-d962-4158-9a6c-e38cbd2b3e04] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:02.242093 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:41:02.247366 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-164b27ea-48ae-4f76-b48b-42351233f15d tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:02.247897 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-164b27ea-48ae-4f76-b48b-42351233f15d tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:02.248364 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-164b27ea-48ae-4f76-b48b-42351233f15d tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:02.249365 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-164b27ea-48ae-4f76-b48b-42351233f15d tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:02.249831 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-164b27ea-48ae-4f76-b48b-42351233f15d tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:02.250258 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-164b27ea-48ae-4f76-b48b-42351233f15d tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:02.387220 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-164b27ea-48ae-4f76-b48b-42351233f15d tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:02.395925 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-164b27ea-48ae-4f76-b48b-42351233f15d tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04" status: 200 len: 1523 microversion: 2.1 time: 0.161046 Nov 02 14:41:02.396567 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 99/194] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:02 2022] GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:02.740126 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-ab8330ab-2510-4b5d-8eab-71de68a3d0f1 tempest-VolumesSnapshotsTestJSON-1170943817 tempest-VolumesSnapshotsTestJSON-1170943817-project] Calling method '.version_select at 0x7fb24f020550>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:02.766662 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.wsgi [None req-ab8330ab-2510-4b5d-8eab-71de68a3d0f1 tempest-VolumesSnapshotsTestJSON-1170943817 tempest-VolumesSnapshotsTestJSON-1170943817-project] HTTP exception thrown: Snapshot d5e69888-c4bc-46e2-83c4-64d0fbace992 could not be found. Nov 02 14:41:02.769941 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-ab8330ab-2510-4b5d-8eab-71de68a3d0f1 tempest-VolumesSnapshotsTestJSON-1170943817 tempest-VolumesSnapshotsTestJSON-1170943817-project] Request method failure captured: Nov 02 14:41:02.769941 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: request: GET /compute/v2.1/os-snapshots/d5e69888-c4bc-46e2-83c4-64d0fbace992 HTTP/1.1 Nov 02 14:41:02.769941 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Accept: application/json Nov 02 14:41:02.769941 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Accept-Encoding: identity Nov 02 14:41:02.769941 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Connection: close Nov 02 14:41:02.769941 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Content-Length: 0 Nov 02 14:41:02.769941 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Content-Type: application/json Nov 02 14:41:02.769941 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Host: 10.222.0.30 Nov 02 14:41:02.769941 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Openstack-System-Scope: None Nov 02 14:41:02.769941 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: User-Agent: python-urllib3/1.26.12 Nov 02 14:41:02.769941 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Auth-Token: gAAAAABjYoFzq2MtIcRwmEdfBimIVXb6FFhmINPgypmx4_96yjnFV045MYDSTLIYpHLgbgW3ERck1hKulZefmW6Qpd0CcIWRglxpQ3areRONzEpR5fekKS_eqX56xSc_yLg21AkF28vhKpA4MIlAZ-N09RyccN6BvGUeKpF6OaHNug8U4ZRNkso Nov 02 14:41:02.769941 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Domain-Id: None Nov 02 14:41:02.769941 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Domain-Name: None Nov 02 14:41:02.769941 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Identity-Status: Confirmed Nov 02 14:41:02.769941 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Is-Admin-Project: True Nov 02 14:41:02.769941 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Domain-Id: default Nov 02 14:41:02.769941 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Domain-Name: Default Nov 02 14:41:02.769941 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Id: d2eb08b7b586486e8ff815c65419c1f4 Nov 02 14:41:02.769941 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1170943817 Nov 02 14:41:02.769941 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Role: reader,member Nov 02 14:41:02.769941 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Roles: reader,member Nov 02 14:41:02.771479 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d2eb08b7b586486e8ff815c65419c1f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d2eb08b7b586486e8ff815c65419c1f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d2eb08b7b586486e8ff815c65419c1f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d2eb08b7b586486e8ff815c65419c1f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:41:02.771479 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1170943817 Nov 02 14:41:02.771479 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant-Id: d2eb08b7b586486e8ff815c65419c1f4 Nov 02 14:41:02.771479 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1170943817 Nov 02 14:41:02.771479 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User: tempest-VolumesSnapshotsTestJSON-1170943817-project Nov 02 14:41:02.771479 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Domain-Id: default Nov 02 14:41:02.771479 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Domain-Name: Default Nov 02 14:41:02.771479 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Id: 928f4340b3e646f9b1a232160609fa7b Nov 02 14:41:02.771479 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1170943817-project Nov 02 14:41:02.771479 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: method: Nov 02 14:41:02.771479 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: exception: Snapshot d5e69888-c4bc-46e2-83c4-64d0fbace992 could not be found. Nov 02 14:41:02.771479 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: action_args: {'id': 'd5e69888-c4bc-46e2-83c4-64d0fbace992'} Nov 02 14:41:02.771479 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:41:02.772359 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:41:02.772359 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Nov 02 14:41:02.772359 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Nov 02 14:41:02.772359 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Nov 02 14:41:02.772359 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Nov 02 14:41:02.772359 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Nov 02 14:41:02.772359 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Nov 02 14:41:02.772359 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 14:41:02.772359 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 14:41:02.772359 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 14:41:02.772359 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 14:41:02.772359 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 14:41:02.772359 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 14:41:02.772359 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 14:41:02.772359 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 14:41:02.772359 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot d5e69888-c4bc-46e2-83c4-64d0fbace992 could not be found. (HTTP 404) (Request-ID: req-f6004032-ccd3-42a9-81a3-2e8180b0ccbf) Nov 02 14:41:02.772359 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:41:02.772359 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:41:02.773564 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:41:02.773564 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:41:02.773564 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Nov 02 14:41:02.773564 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Nov 02 14:41:02.773564 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 14:41:02.773564 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 14:41:02.773564 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Nov 02 14:41:02.773564 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Nov 02 14:41:02.773564 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 14:41:02.773564 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 14:41:02.773564 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Nov 02 14:41:02.773564 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Nov 02 14:41:02.773564 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Nov 02 14:41:02.773564 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Nov 02 14:41:02.773564 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Nov 02 14:41:02.773564 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Nov 02 14:41:02.773564 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 14:41:02.773564 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 14:41:02.773564 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 14:41:02.774613 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 14:41:02.774613 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 14:41:02.774613 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 14:41:02.774613 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 14:41:02.774613 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 14:41:02.774613 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot d5e69888-c4bc-46e2-83c4-64d0fbace992 could not be found. Nov 02 14:41:02.774613 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:41:02.774613 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:41:02.774613 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:41:02.774613 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:41:02.774613 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:41:02.774613 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:41:02.774613 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:41:02.774613 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:41:02.774613 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 14:41:02.774613 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 14:41:02.774613 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:41:02.774613 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:41:02.774613 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Nov 02 14:41:02.774613 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:41:02.776110 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot d5e69888-c4bc-46e2-83c4-64d0fbace992 could not be found. Nov 02 14:41:02.776110 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:41:02.776110 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:41:02.776110 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:41:02.776110 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:41:02.776110 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:41:02.776110 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:41:02.776110 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:41:02.776110 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:41:02.776110 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot d5e69888-c4bc-46e2-83c4-64d0fbace992 could not be found. Nov 02 14:41:02.776110 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:41:02.776110 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-ab8330ab-2510-4b5d-8eab-71de68a3d0f1 tempest-VolumesSnapshotsTestJSON-1170943817 tempest-VolumesSnapshotsTestJSON-1170943817-project] Returning 404 to user: Snapshot d5e69888-c4bc-46e2-83c4-64d0fbace992 could not be found. {{(pid=119658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:41:02.776110 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-ab8330ab-2510-4b5d-8eab-71de68a3d0f1 tempest-VolumesSnapshotsTestJSON-1170943817 tempest-VolumesSnapshotsTestJSON-1170943817-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/d5e69888-c4bc-46e2-83c4-64d0fbace992" status: 404 len: 111 microversion: 2.1 time: 0.035219 Nov 02 14:41:02.776980 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 96/195] 10.222.0.30 () {58 vars in 1251 bytes} [Wed Nov 2 14:41:02 2022] GET /compute/v2.1/os-snapshots/d5e69888-c4bc-46e2-83c4-64d0fbace992 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:41:02.781486 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-a9d93d6c-2d29-48aa-a29f-21a3ea8cfa72 tempest-VolumesSnapshotsTestJSON-1170943817 tempest-VolumesSnapshotsTestJSON-1170943817-project] Calling method '.version_select at 0x7fb24efa8550>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:03.021548 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-a9d93d6c-2d29-48aa-a29f-21a3ea8cfa72 tempest-VolumesSnapshotsTestJSON-1170943817 tempest-VolumesSnapshotsTestJSON-1170943817-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/e7b17b32-6ada-4a84-9b8f-7743f77c2387" status: 202 len: 0 microversion: 2.1 time: 0.244736 Nov 02 14:41:03.022116 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 100/196] 10.222.0.30 () {58 vars in 1248 bytes} [Wed Nov 2 14:41:02 2022] DELETE /compute/v2.1/os-volumes/e7b17b32-6ada-4a84-9b8f-7743f77c2387 => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:41:03.032579 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-0d517b54-8bd4-4ed5-938b-87d261fa0412 tempest-VolumesSnapshotsTestJSON-1170943817 tempest-VolumesSnapshotsTestJSON-1170943817-project] Calling method '.version_select at 0x7fb24f015dc0>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:03.094305 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-0d517b54-8bd4-4ed5-938b-87d261fa0412 tempest-VolumesSnapshotsTestJSON-1170943817 tempest-VolumesSnapshotsTestJSON-1170943817-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/e7b17b32-6ada-4a84-9b8f-7743f77c2387" status: 200 len: 345 microversion: 2.1 time: 0.067131 Nov 02 14:41:03.096301 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 97/197] 10.222.0.30 () {58 vars in 1245 bytes} [Wed Nov 2 14:41:03 2022] GET /compute/v2.1/os-volumes/e7b17b32-6ada-4a84-9b8f-7743f77c2387 => generated 345 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:41:03.422010 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-d9f9f3ab-c006-4426-a423-ba3ed973dff0 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:03.422598 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-d9f9f3ab-c006-4426-a423-ba3ed973dff0 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 803e6b19-d962-4158-9a6c-e38cbd2b3e04] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:03.429631 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d9f9f3ab-c006-4426-a423-ba3ed973dff0 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:03.438606 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d9f9f3ab-c006-4426-a423-ba3ed973dff0 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:03.438606 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d9f9f3ab-c006-4426-a423-ba3ed973dff0 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:03.438606 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d9f9f3ab-c006-4426-a423-ba3ed973dff0 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:03.438606 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d9f9f3ab-c006-4426-a423-ba3ed973dff0 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:03.439228 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d9f9f3ab-c006-4426-a423-ba3ed973dff0 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:03.587841 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-d9f9f3ab-c006-4426-a423-ba3ed973dff0 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:03.590851 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-d9f9f3ab-c006-4426-a423-ba3ed973dff0 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04" status: 200 len: 1523 microversion: 2.1 time: 0.173818 Nov 02 14:41:03.591426 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 101/198] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:03 2022] GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04 => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:04.109759 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-b723cd43-eaa6-418b-b971-0e0c321f855d tempest-VolumesSnapshotsTestJSON-1170943817 tempest-VolumesSnapshotsTestJSON-1170943817-project] Calling method '.version_select at 0x7fb24f023d30>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:04.141369 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.wsgi [None req-b723cd43-eaa6-418b-b971-0e0c321f855d tempest-VolumesSnapshotsTestJSON-1170943817 tempest-VolumesSnapshotsTestJSON-1170943817-project] HTTP exception thrown: Volume e7b17b32-6ada-4a84-9b8f-7743f77c2387 could not be found. Nov 02 14:41:04.143751 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-b723cd43-eaa6-418b-b971-0e0c321f855d tempest-VolumesSnapshotsTestJSON-1170943817 tempest-VolumesSnapshotsTestJSON-1170943817-project] Request method failure captured: Nov 02 14:41:04.143751 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: request: GET /compute/v2.1/os-volumes/e7b17b32-6ada-4a84-9b8f-7743f77c2387 HTTP/1.1 Nov 02 14:41:04.143751 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Accept: application/json Nov 02 14:41:04.143751 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Accept-Encoding: identity Nov 02 14:41:04.143751 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Connection: close Nov 02 14:41:04.143751 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Content-Length: 0 Nov 02 14:41:04.143751 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Content-Type: application/json Nov 02 14:41:04.143751 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Host: 10.222.0.30 Nov 02 14:41:04.143751 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Openstack-System-Scope: None Nov 02 14:41:04.143751 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: User-Agent: python-urllib3/1.26.12 Nov 02 14:41:04.143751 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Auth-Token: gAAAAABjYoFzq2MtIcRwmEdfBimIVXb6FFhmINPgypmx4_96yjnFV045MYDSTLIYpHLgbgW3ERck1hKulZefmW6Qpd0CcIWRglxpQ3areRONzEpR5fekKS_eqX56xSc_yLg21AkF28vhKpA4MIlAZ-N09RyccN6BvGUeKpF6OaHNug8U4ZRNkso Nov 02 14:41:04.143751 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Domain-Id: None Nov 02 14:41:04.143751 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Domain-Name: None Nov 02 14:41:04.143751 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Identity-Status: Confirmed Nov 02 14:41:04.143751 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Is-Admin-Project: True Nov 02 14:41:04.143751 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Domain-Id: default Nov 02 14:41:04.143751 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Domain-Name: Default Nov 02 14:41:04.143751 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Id: d2eb08b7b586486e8ff815c65419c1f4 Nov 02 14:41:04.143751 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1170943817 Nov 02 14:41:04.143751 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Role: reader,member Nov 02 14:41:04.143751 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Roles: reader,member Nov 02 14:41:04.145236 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d2eb08b7b586486e8ff815c65419c1f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d2eb08b7b586486e8ff815c65419c1f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d2eb08b7b586486e8ff815c65419c1f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d2eb08b7b586486e8ff815c65419c1f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:41:04.145236 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1170943817 Nov 02 14:41:04.145236 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant-Id: d2eb08b7b586486e8ff815c65419c1f4 Nov 02 14:41:04.145236 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1170943817 Nov 02 14:41:04.145236 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User: tempest-VolumesSnapshotsTestJSON-1170943817-project Nov 02 14:41:04.145236 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Domain-Id: default Nov 02 14:41:04.145236 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Domain-Name: Default Nov 02 14:41:04.145236 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Id: 928f4340b3e646f9b1a232160609fa7b Nov 02 14:41:04.145236 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1170943817-project Nov 02 14:41:04.145236 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: method: Nov 02 14:41:04.145236 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: exception: Volume e7b17b32-6ada-4a84-9b8f-7743f77c2387 could not be found. Nov 02 14:41:04.145236 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: action_args: {'id': 'e7b17b32-6ada-4a84-9b8f-7743f77c2387'} Nov 02 14:41:04.145236 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:41:04.146114 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:41:04.146114 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 14:41:04.146114 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 14:41:04.146114 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 14:41:04.146114 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 14:41:04.146114 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 14:41:04.146114 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 14:41:04.146114 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 14:41:04.146114 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 14:41:04.146114 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 14:41:04.146114 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 14:41:04.146114 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 14:41:04.146114 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 14:41:04.146114 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 14:41:04.146114 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 14:41:04.146114 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e7b17b32-6ada-4a84-9b8f-7743f77c2387 could not be found. (HTTP 404) (Request-ID: req-a809958d-eca8-4949-acc5-99a58744f84c) Nov 02 14:41:04.146114 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:41:04.146114 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:41:04.146114 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:41:04.147151 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:41:04.147151 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Nov 02 14:41:04.147151 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Nov 02 14:41:04.147151 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 14:41:04.147151 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 14:41:04.147151 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 14:41:04.147151 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 14:41:04.147151 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 14:41:04.147151 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 14:41:04.147151 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 14:41:04.147151 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 14:41:04.147151 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 14:41:04.147151 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 14:41:04.147151 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 14:41:04.147151 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 14:41:04.147151 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 14:41:04.147151 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 14:41:04.147151 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 14:41:04.147151 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 14:41:04.148318 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 14:41:04.148318 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 14:41:04.148318 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 14:41:04.148318 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 14:41:04.148318 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e7b17b32-6ada-4a84-9b8f-7743f77c2387 could not be found. Nov 02 14:41:04.148318 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:41:04.148318 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:41:04.148318 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:41:04.148318 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:41:04.148318 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:41:04.148318 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:41:04.148318 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:41:04.148318 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:41:04.148318 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 14:41:04.148318 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 14:41:04.148318 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:41:04.148318 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:41:04.148318 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Nov 02 14:41:04.148318 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:41:04.149498 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e7b17b32-6ada-4a84-9b8f-7743f77c2387 could not be found. Nov 02 14:41:04.149498 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:41:04.149498 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:41:04.149498 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:41:04.149498 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:41:04.149498 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:41:04.149498 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:41:04.149498 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:41:04.149498 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:41:04.149498 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e7b17b32-6ada-4a84-9b8f-7743f77c2387 could not be found. Nov 02 14:41:04.149498 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:41:04.149498 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-b723cd43-eaa6-418b-b971-0e0c321f855d tempest-VolumesSnapshotsTestJSON-1170943817 tempest-VolumesSnapshotsTestJSON-1170943817-project] Returning 404 to user: Volume e7b17b32-6ada-4a84-9b8f-7743f77c2387 could not be found. {{(pid=119658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:41:04.149498 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-b723cd43-eaa6-418b-b971-0e0c321f855d tempest-VolumesSnapshotsTestJSON-1170943817 tempest-VolumesSnapshotsTestJSON-1170943817-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/e7b17b32-6ada-4a84-9b8f-7743f77c2387" status: 404 len: 109 microversion: 2.1 time: 0.039424 Nov 02 14:41:04.149498 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 98/199] 10.222.0.30 () {58 vars in 1245 bytes} [Wed Nov 2 14:41:04 2022] GET /compute/v2.1/os-volumes/e7b17b32-6ada-4a84-9b8f-7743f77c2387 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:41:04.160082 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-60442561-fd47-459b-9646-bd67593ad769 tempest-VolumesSnapshotsTestJSON-1170943817 tempest-VolumesSnapshotsTestJSON-1170943817-project] Calling method '.version_select at 0x7fb24f0f95e0>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:04.190196 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.wsgi [None req-60442561-fd47-459b-9646-bd67593ad769 tempest-VolumesSnapshotsTestJSON-1170943817 tempest-VolumesSnapshotsTestJSON-1170943817-project] HTTP exception thrown: Volume e7b17b32-6ada-4a84-9b8f-7743f77c2387 could not be found. Nov 02 14:41:04.192404 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-60442561-fd47-459b-9646-bd67593ad769 tempest-VolumesSnapshotsTestJSON-1170943817 tempest-VolumesSnapshotsTestJSON-1170943817-project] Request method failure captured: Nov 02 14:41:04.192404 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: request: DELETE /compute/v2.1/os-volumes/e7b17b32-6ada-4a84-9b8f-7743f77c2387 HTTP/1.1 Nov 02 14:41:04.192404 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Accept: application/json Nov 02 14:41:04.192404 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Accept-Encoding: identity Nov 02 14:41:04.192404 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Connection: close Nov 02 14:41:04.192404 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Content-Length: 0 Nov 02 14:41:04.192404 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Content-Type: application/json Nov 02 14:41:04.192404 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Host: 10.222.0.30 Nov 02 14:41:04.192404 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Openstack-System-Scope: None Nov 02 14:41:04.192404 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: User-Agent: python-urllib3/1.26.12 Nov 02 14:41:04.192404 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Auth-Token: gAAAAABjYoFzq2MtIcRwmEdfBimIVXb6FFhmINPgypmx4_96yjnFV045MYDSTLIYpHLgbgW3ERck1hKulZefmW6Qpd0CcIWRglxpQ3areRONzEpR5fekKS_eqX56xSc_yLg21AkF28vhKpA4MIlAZ-N09RyccN6BvGUeKpF6OaHNug8U4ZRNkso Nov 02 14:41:04.192404 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Domain-Id: None Nov 02 14:41:04.192404 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Domain-Name: None Nov 02 14:41:04.192404 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Identity-Status: Confirmed Nov 02 14:41:04.192404 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Is-Admin-Project: True Nov 02 14:41:04.192404 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Domain-Id: default Nov 02 14:41:04.192404 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Domain-Name: Default Nov 02 14:41:04.192404 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Id: d2eb08b7b586486e8ff815c65419c1f4 Nov 02 14:41:04.192404 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1170943817 Nov 02 14:41:04.192404 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Role: reader,member Nov 02 14:41:04.192404 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Roles: reader,member Nov 02 14:41:04.193895 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d2eb08b7b586486e8ff815c65419c1f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d2eb08b7b586486e8ff815c65419c1f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d2eb08b7b586486e8ff815c65419c1f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d2eb08b7b586486e8ff815c65419c1f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:41:04.193895 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1170943817 Nov 02 14:41:04.193895 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant-Id: d2eb08b7b586486e8ff815c65419c1f4 Nov 02 14:41:04.193895 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1170943817 Nov 02 14:41:04.193895 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User: tempest-VolumesSnapshotsTestJSON-1170943817-project Nov 02 14:41:04.193895 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Domain-Id: default Nov 02 14:41:04.193895 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Domain-Name: Default Nov 02 14:41:04.193895 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Id: 928f4340b3e646f9b1a232160609fa7b Nov 02 14:41:04.193895 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1170943817-project Nov 02 14:41:04.193895 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: method: Nov 02 14:41:04.193895 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: exception: Volume e7b17b32-6ada-4a84-9b8f-7743f77c2387 could not be found. Nov 02 14:41:04.193895 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: action_args: {'id': 'e7b17b32-6ada-4a84-9b8f-7743f77c2387'} Nov 02 14:41:04.193895 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:41:04.194771 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:41:04.194771 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 14:41:04.194771 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 14:41:04.194771 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 14:41:04.194771 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 14:41:04.194771 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 14:41:04.194771 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 14:41:04.194771 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 14:41:04.194771 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 14:41:04.194771 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 14:41:04.194771 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 14:41:04.194771 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 14:41:04.194771 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 14:41:04.194771 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 14:41:04.194771 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 14:41:04.194771 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e7b17b32-6ada-4a84-9b8f-7743f77c2387 could not be found. (HTTP 404) (Request-ID: req-843f6cdd-0036-4895-8556-e169640c2e58) Nov 02 14:41:04.194771 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:41:04.194771 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:41:04.194771 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:41:04.196155 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:41:04.196155 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Nov 02 14:41:04.196155 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Nov 02 14:41:04.196155 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 14:41:04.196155 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 14:41:04.196155 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 14:41:04.196155 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 14:41:04.196155 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 14:41:04.196155 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 14:41:04.196155 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 14:41:04.196155 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 14:41:04.196155 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 14:41:04.196155 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 14:41:04.196155 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 14:41:04.196155 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 14:41:04.196155 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 14:41:04.196155 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 14:41:04.196155 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 14:41:04.196155 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 14:41:04.197706 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 14:41:04.197706 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 14:41:04.197706 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 14:41:04.197706 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 14:41:04.197706 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e7b17b32-6ada-4a84-9b8f-7743f77c2387 could not be found. Nov 02 14:41:04.197706 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:41:04.197706 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:41:04.197706 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:41:04.197706 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:41:04.197706 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:41:04.197706 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:41:04.197706 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:41:04.197706 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:41:04.197706 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 14:41:04.197706 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 14:41:04.197706 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:41:04.197706 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:41:04.197706 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Nov 02 14:41:04.197706 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:41:04.198937 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e7b17b32-6ada-4a84-9b8f-7743f77c2387 could not be found. Nov 02 14:41:04.198937 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:41:04.198937 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:41:04.198937 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:41:04.198937 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:41:04.198937 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:41:04.198937 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:41:04.198937 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:41:04.198937 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:41:04.198937 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e7b17b32-6ada-4a84-9b8f-7743f77c2387 could not be found. Nov 02 14:41:04.198937 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:41:04.198937 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-60442561-fd47-459b-9646-bd67593ad769 tempest-VolumesSnapshotsTestJSON-1170943817 tempest-VolumesSnapshotsTestJSON-1170943817-project] Returning 404 to user: Volume e7b17b32-6ada-4a84-9b8f-7743f77c2387 could not be found. {{(pid=119659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:41:04.198937 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-60442561-fd47-459b-9646-bd67593ad769 tempest-VolumesSnapshotsTestJSON-1170943817 tempest-VolumesSnapshotsTestJSON-1170943817-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/e7b17b32-6ada-4a84-9b8f-7743f77c2387" status: 404 len: 109 microversion: 2.1 time: 0.037716 Nov 02 14:41:04.198937 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 102/200] 10.222.0.30 () {58 vars in 1248 bytes} [Wed Nov 2 14:41:04 2022] DELETE /compute/v2.1/os-volumes/e7b17b32-6ada-4a84-9b8f-7743f77c2387 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 14:41:04.203280 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-c88e59e2-1d19-44e5-8e3e-36295eff9fe5 tempest-VolumesSnapshotsTestJSON-1170943817 tempest-VolumesSnapshotsTestJSON-1170943817-project] Calling method '.version_select at 0x7fb24f020700>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:04.231079 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.wsgi [None req-c88e59e2-1d19-44e5-8e3e-36295eff9fe5 tempest-VolumesSnapshotsTestJSON-1170943817 tempest-VolumesSnapshotsTestJSON-1170943817-project] HTTP exception thrown: Volume e7b17b32-6ada-4a84-9b8f-7743f77c2387 could not be found. Nov 02 14:41:04.233795 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-c88e59e2-1d19-44e5-8e3e-36295eff9fe5 tempest-VolumesSnapshotsTestJSON-1170943817 tempest-VolumesSnapshotsTestJSON-1170943817-project] Request method failure captured: Nov 02 14:41:04.233795 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: request: GET /compute/v2.1/os-volumes/e7b17b32-6ada-4a84-9b8f-7743f77c2387 HTTP/1.1 Nov 02 14:41:04.233795 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Accept: application/json Nov 02 14:41:04.233795 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Accept-Encoding: identity Nov 02 14:41:04.233795 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Connection: close Nov 02 14:41:04.233795 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Content-Length: 0 Nov 02 14:41:04.233795 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Content-Type: application/json Nov 02 14:41:04.233795 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Host: 10.222.0.30 Nov 02 14:41:04.233795 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Openstack-System-Scope: None Nov 02 14:41:04.233795 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: User-Agent: python-urllib3/1.26.12 Nov 02 14:41:04.233795 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Auth-Token: gAAAAABjYoFzq2MtIcRwmEdfBimIVXb6FFhmINPgypmx4_96yjnFV045MYDSTLIYpHLgbgW3ERck1hKulZefmW6Qpd0CcIWRglxpQ3areRONzEpR5fekKS_eqX56xSc_yLg21AkF28vhKpA4MIlAZ-N09RyccN6BvGUeKpF6OaHNug8U4ZRNkso Nov 02 14:41:04.233795 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Domain-Id: None Nov 02 14:41:04.233795 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Domain-Name: None Nov 02 14:41:04.233795 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Identity-Status: Confirmed Nov 02 14:41:04.233795 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Is-Admin-Project: True Nov 02 14:41:04.233795 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Domain-Id: default Nov 02 14:41:04.233795 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Domain-Name: Default Nov 02 14:41:04.233795 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Id: d2eb08b7b586486e8ff815c65419c1f4 Nov 02 14:41:04.233795 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1170943817 Nov 02 14:41:04.233795 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Role: reader,member Nov 02 14:41:04.233795 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Roles: reader,member Nov 02 14:41:04.235528 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d2eb08b7b586486e8ff815c65419c1f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d2eb08b7b586486e8ff815c65419c1f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d2eb08b7b586486e8ff815c65419c1f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d2eb08b7b586486e8ff815c65419c1f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:41:04.235528 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1170943817 Nov 02 14:41:04.235528 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant-Id: d2eb08b7b586486e8ff815c65419c1f4 Nov 02 14:41:04.235528 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1170943817 Nov 02 14:41:04.235528 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User: tempest-VolumesSnapshotsTestJSON-1170943817-project Nov 02 14:41:04.235528 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Domain-Id: default Nov 02 14:41:04.235528 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Domain-Name: Default Nov 02 14:41:04.235528 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Id: 928f4340b3e646f9b1a232160609fa7b Nov 02 14:41:04.235528 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1170943817-project Nov 02 14:41:04.235528 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: method: Nov 02 14:41:04.235528 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: exception: Volume e7b17b32-6ada-4a84-9b8f-7743f77c2387 could not be found. Nov 02 14:41:04.235528 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: action_args: {'id': 'e7b17b32-6ada-4a84-9b8f-7743f77c2387'} Nov 02 14:41:04.235528 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:41:04.236394 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:41:04.236394 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 14:41:04.236394 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 14:41:04.236394 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 14:41:04.236394 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 14:41:04.236394 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 14:41:04.236394 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 14:41:04.236394 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 14:41:04.236394 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 14:41:04.236394 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 14:41:04.236394 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 14:41:04.236394 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 14:41:04.236394 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 14:41:04.236394 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 14:41:04.236394 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 14:41:04.236394 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e7b17b32-6ada-4a84-9b8f-7743f77c2387 could not be found. (HTTP 404) (Request-ID: req-2eb9eca6-d6fe-4291-8a2c-02a966e00776) Nov 02 14:41:04.236394 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:41:04.236394 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:41:04.236394 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:41:04.246554 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:41:04.246554 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Nov 02 14:41:04.246554 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Nov 02 14:41:04.246554 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 14:41:04.246554 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 14:41:04.246554 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 14:41:04.246554 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 14:41:04.246554 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 14:41:04.246554 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 14:41:04.246554 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 14:41:04.246554 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 14:41:04.246554 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 14:41:04.246554 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 14:41:04.246554 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 14:41:04.246554 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 14:41:04.246554 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 14:41:04.246554 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 14:41:04.246554 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 14:41:04.246554 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 14:41:04.249202 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 14:41:04.249202 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 14:41:04.249202 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 14:41:04.249202 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 14:41:04.249202 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e7b17b32-6ada-4a84-9b8f-7743f77c2387 could not be found. Nov 02 14:41:04.249202 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:41:04.249202 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:41:04.249202 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:41:04.249202 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:41:04.249202 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:41:04.249202 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:41:04.249202 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:41:04.249202 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:41:04.249202 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 14:41:04.249202 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 14:41:04.249202 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:41:04.249202 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:41:04.249202 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Nov 02 14:41:04.249202 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:41:04.250829 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e7b17b32-6ada-4a84-9b8f-7743f77c2387 could not be found. Nov 02 14:41:04.250829 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:41:04.250829 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:41:04.250829 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:41:04.250829 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:41:04.250829 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:41:04.250829 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:41:04.250829 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:41:04.250829 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:41:04.250829 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e7b17b32-6ada-4a84-9b8f-7743f77c2387 could not be found. Nov 02 14:41:04.250829 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:41:04.250829 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-c88e59e2-1d19-44e5-8e3e-36295eff9fe5 tempest-VolumesSnapshotsTestJSON-1170943817 tempest-VolumesSnapshotsTestJSON-1170943817-project] Returning 404 to user: Volume e7b17b32-6ada-4a84-9b8f-7743f77c2387 could not be found. {{(pid=119658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:41:04.250829 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-c88e59e2-1d19-44e5-8e3e-36295eff9fe5 tempest-VolumesSnapshotsTestJSON-1170943817 tempest-VolumesSnapshotsTestJSON-1170943817-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/e7b17b32-6ada-4a84-9b8f-7743f77c2387" status: 404 len: 109 microversion: 2.1 time: 0.036560 Nov 02 14:41:04.250829 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 99/201] 10.222.0.30 () {58 vars in 1245 bytes} [Wed Nov 2 14:41:04 2022] GET /compute/v2.1/os-volumes/e7b17b32-6ada-4a84-9b8f-7743f77c2387 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 14:41:04.615386 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-966246f7-72c5-47a6-a36c-f074b9261f10 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:04.616029 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-966246f7-72c5-47a6-a36c-f074b9261f10 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 803e6b19-d962-4158-9a6c-e38cbd2b3e04] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:04.627518 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-966246f7-72c5-47a6-a36c-f074b9261f10 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:04.627518 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-966246f7-72c5-47a6-a36c-f074b9261f10 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:04.627518 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-966246f7-72c5-47a6-a36c-f074b9261f10 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:04.627518 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-966246f7-72c5-47a6-a36c-f074b9261f10 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:04.628133 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-966246f7-72c5-47a6-a36c-f074b9261f10 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:04.628133 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-966246f7-72c5-47a6-a36c-f074b9261f10 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:04.764781 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-966246f7-72c5-47a6-a36c-f074b9261f10 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:04.773126 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-966246f7-72c5-47a6-a36c-f074b9261f10 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04" status: 200 len: 1523 microversion: 2.1 time: 0.161956 Nov 02 14:41:04.773790 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 103/202] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:04 2022] GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:05.796160 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-84fe47d5-58b8-4fbc-9246-3bb9145ace06 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:05.796889 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-84fe47d5-58b8-4fbc-9246-3bb9145ace06 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 803e6b19-d962-4158-9a6c-e38cbd2b3e04] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:05.798854 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_api:SELECT=34 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:41:05.803825 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-84fe47d5-58b8-4fbc-9246-3bb9145ace06 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:05.804847 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-84fe47d5-58b8-4fbc-9246-3bb9145ace06 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:05.804847 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-84fe47d5-58b8-4fbc-9246-3bb9145ace06 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:05.805604 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-84fe47d5-58b8-4fbc-9246-3bb9145ace06 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:05.806053 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-84fe47d5-58b8-4fbc-9246-3bb9145ace06 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:05.806669 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-84fe47d5-58b8-4fbc-9246-3bb9145ace06 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:06.018615 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-84fe47d5-58b8-4fbc-9246-3bb9145ace06 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:06.033418 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-84fe47d5-58b8-4fbc-9246-3bb9145ace06 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04" status: 200 len: 1523 microversion: 2.1 time: 0.241180 Nov 02 14:41:06.034013 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 100/203] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:05 2022] GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04 => generated 1523 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:07.056812 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-a6b89a6d-9590-4b32-b10d-4400e2b5d1d5 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:07.058152 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-a6b89a6d-9590-4b32-b10d-4400e2b5d1d5 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 803e6b19-d962-4158-9a6c-e38cbd2b3e04] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:07.066452 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a6b89a6d-9590-4b32-b10d-4400e2b5d1d5 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:07.071144 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a6b89a6d-9590-4b32-b10d-4400e2b5d1d5 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:07.071144 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a6b89a6d-9590-4b32-b10d-4400e2b5d1d5 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:07.071144 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a6b89a6d-9590-4b32-b10d-4400e2b5d1d5 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:07.071144 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a6b89a6d-9590-4b32-b10d-4400e2b5d1d5 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:07.071507 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a6b89a6d-9590-4b32-b10d-4400e2b5d1d5 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:07.219031 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-a6b89a6d-9590-4b32-b10d-4400e2b5d1d5 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:07.232084 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-a6b89a6d-9590-4b32-b10d-4400e2b5d1d5 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04" status: 200 len: 1523 microversion: 2.1 time: 0.174596 Nov 02 14:41:07.232084 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 104/204] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:07 2022] GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04 => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:08.254826 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-52aeb9f0-0d1c-461e-8ba3-70b79d5c4649 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:08.255423 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-52aeb9f0-0d1c-461e-8ba3-70b79d5c4649 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 803e6b19-d962-4158-9a6c-e38cbd2b3e04] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:08.261691 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-52aeb9f0-0d1c-461e-8ba3-70b79d5c4649 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:08.262226 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-52aeb9f0-0d1c-461e-8ba3-70b79d5c4649 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:08.262663 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-52aeb9f0-0d1c-461e-8ba3-70b79d5c4649 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:08.263379 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-52aeb9f0-0d1c-461e-8ba3-70b79d5c4649 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:08.263831 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-52aeb9f0-0d1c-461e-8ba3-70b79d5c4649 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:08.264253 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-52aeb9f0-0d1c-461e-8ba3-70b79d5c4649 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:08.412907 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-52aeb9f0-0d1c-461e-8ba3-70b79d5c4649 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:08.421414 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-52aeb9f0-0d1c-461e-8ba3-70b79d5c4649 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04" status: 200 len: 1523 microversion: 2.1 time: 0.170100 Nov 02 14:41:08.422148 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 101/205] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:08 2022] GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:41:09.123732 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-74ff58f9-4749-49e9-b5de-af0dc28d1ff6 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2115256000", "imageRef": "a726a246-cc7f-46e6-aeff-4d62e03cc091", "flavorRef": "452", "networks": [{"uuid": "5567c379-db86-4c8e-933e-4117b6a0d5fa"}]}} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:41:09.324945 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.network.neutron [None req-74ff58f9-4749-49e9-b5de-af0dc28d1ff6 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] validate_networks() for [('5567c379-db86-4c8e-933e-4117b6a0d5fa', None, None, None, None, None)] {{(pid=119659) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:41:09.446293 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-86f16f69-40d2-479b-867b-bcca8841771d tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:09.446902 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-86f16f69-40d2-479b-867b-bcca8841771d tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 803e6b19-d962-4158-9a6c-e38cbd2b3e04] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:09.456335 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-86f16f69-40d2-479b-867b-bcca8841771d tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:09.456929 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-86f16f69-40d2-479b-867b-bcca8841771d tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:09.457452 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-86f16f69-40d2-479b-867b-bcca8841771d tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:09.458162 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-86f16f69-40d2-479b-867b-bcca8841771d tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:09.458615 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-86f16f69-40d2-479b-867b-bcca8841771d tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:09.459040 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-86f16f69-40d2-479b-867b-bcca8841771d tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:09.722430 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-86f16f69-40d2-479b-867b-bcca8841771d tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:09.730932 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-86f16f69-40d2-479b-867b-bcca8841771d tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04" status: 200 len: 1523 microversion: 2.1 time: 0.288728 Nov 02 14:41:09.731493 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 102/206] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:09 2022] GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04 => generated 1523 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:09.881824 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.virt.hardware [None req-74ff58f9-4749-49e9-b5de-af0dc28d1ff6 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Flavor limits 0:0:0 {{(pid=119659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:41:09.882241 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.virt.hardware [None req-74ff58f9-4749-49e9-b5de-af0dc28d1ff6 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Image limits 0:0:0 {{(pid=119659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:41:09.882712 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.virt.hardware [None req-74ff58f9-4749-49e9-b5de-af0dc28d1ff6 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Flavor pref 0:0:0 {{(pid=119659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:41:09.883119 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.virt.hardware [None req-74ff58f9-4749-49e9-b5de-af0dc28d1ff6 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Image pref 0:0:0 {{(pid=119659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:41:09.883524 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.virt.hardware [None req-74ff58f9-4749-49e9-b5de-af0dc28d1ff6 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:41:09.894283 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-74ff58f9-4749-49e9-b5de-af0dc28d1ff6 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:09.895208 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-74ff58f9-4749-49e9-b5de-af0dc28d1ff6 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:09.895748 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-74ff58f9-4749-49e9-b5de-af0dc28d1ff6 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:09.896797 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-74ff58f9-4749-49e9-b5de-af0dc28d1ff6 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:09.897468 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-74ff58f9-4749-49e9-b5de-af0dc28d1ff6 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:09.897893 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-74ff58f9-4749-49e9-b5de-af0dc28d1ff6 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:09.925240 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.quota [None req-74ff58f9-4749-49e9-b5de-af0dc28d1ff6 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Getting quotas for project 47b8cf11e60741e29dfec5f97c462eff. Resources: {'instances', 'ram', 'cores'} {{(pid=119659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:41:09.929718 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.quota [None req-74ff58f9-4749-49e9-b5de-af0dc28d1ff6 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Getting quotas for user c51fbcb1f2714d2c825266ec673348a0 and project 47b8cf11e60741e29dfec5f97c462eff. Resources: {'instances', 'ram', 'cores'} {{(pid=119659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:41:09.944286 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-74ff58f9-4749-49e9-b5de-af0dc28d1ff6 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Going to run 1 instances... {{(pid=119659) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:41:09.946776 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-74ff58f9-4749-49e9-b5de-af0dc28d1ff6 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: 400af7ba-398a-4908-8fea-f57eaa4e5a0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a726a246-cc7f-46e6-aeff-4d62e03cc091',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119659) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:41:10.113270 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-74ff58f9-4749-49e9-b5de-af0dc28d1ff6 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.993362 Nov 02 14:41:10.114205 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 105/207] 10.222.0.30 () {60 vars in 1147 bytes} [Wed Nov 2 14:41:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 995 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:41:10.126102 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-92bc58eb-1f72-4cb1-aef6-68ebef0c09fe tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:10.126810 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-92bc58eb-1f72-4cb1-aef6-68ebef0c09fe tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: 400af7ba-398a-4908-8fea-f57eaa4e5a0f] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:10.181770 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-92bc58eb-1f72-4cb1-aef6-68ebef0c09fe tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:10.188709 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-92bc58eb-1f72-4cb1-aef6-68ebef0c09fe tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f" status: 200 len: 1214 microversion: 2.1 time: 0.066916 Nov 02 14:41:10.189643 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 103/208] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:10 2022] GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:10.754738 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-e1ff4c74-ae34-4820-b83b-d4be1368ab99 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:10.755612 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-e1ff4c74-ae34-4820-b83b-d4be1368ab99 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 803e6b19-d962-4158-9a6c-e38cbd2b3e04] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:10.762254 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e1ff4c74-ae34-4820-b83b-d4be1368ab99 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:10.762741 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e1ff4c74-ae34-4820-b83b-d4be1368ab99 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:10.763183 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e1ff4c74-ae34-4820-b83b-d4be1368ab99 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:10.763884 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e1ff4c74-ae34-4820-b83b-d4be1368ab99 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:10.764379 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e1ff4c74-ae34-4820-b83b-d4be1368ab99 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:10.764815 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e1ff4c74-ae34-4820-b83b-d4be1368ab99 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:10.901774 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-e1ff4c74-ae34-4820-b83b-d4be1368ab99 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:10.910500 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-e1ff4c74-ae34-4820-b83b-d4be1368ab99 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04" status: 200 len: 1523 microversion: 2.1 time: 0.159687 Nov 02 14:41:10.911070 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 106/209] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:10 2022] GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:11.212546 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-41ec2505-6fb0-4b79-a84c-2e4fbed402ce tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:11.213208 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-41ec2505-6fb0-4b79-a84c-2e4fbed402ce tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: 400af7ba-398a-4908-8fea-f57eaa4e5a0f] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:11.266509 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-41ec2505-6fb0-4b79-a84c-2e4fbed402ce tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:11.274132 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-41ec2505-6fb0-4b79-a84c-2e4fbed402ce tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f" status: 200 len: 1214 microversion: 2.1 time: 0.065550 Nov 02 14:41:11.274683 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 104/210] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:11 2022] GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f => generated 1214 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:11.935201 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-16620e83-70b1-4035-a354-959b9c60da9c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:11.936543 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-16620e83-70b1-4035-a354-959b9c60da9c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 803e6b19-d962-4158-9a6c-e38cbd2b3e04] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:11.946628 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-16620e83-70b1-4035-a354-959b9c60da9c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:11.947341 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-16620e83-70b1-4035-a354-959b9c60da9c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:11.948199 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-16620e83-70b1-4035-a354-959b9c60da9c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:11.949116 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-16620e83-70b1-4035-a354-959b9c60da9c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:11.949574 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-16620e83-70b1-4035-a354-959b9c60da9c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:11.950074 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-16620e83-70b1-4035-a354-959b9c60da9c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:12.231794 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-16620e83-70b1-4035-a354-959b9c60da9c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:12.242511 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-16620e83-70b1-4035-a354-959b9c60da9c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04" status: 200 len: 1523 microversion: 2.1 time: 0.312226 Nov 02 14:41:12.243269 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 107/211] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:11 2022] GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04 => generated 1523 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:12.298741 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-60c74a67-a1bd-4a32-aefc-6a4d5bc9b1e1 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:12.299364 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-60c74a67-a1bd-4a32-aefc-6a4d5bc9b1e1 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: 400af7ba-398a-4908-8fea-f57eaa4e5a0f] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:12.305949 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-60c74a67-a1bd-4a32-aefc-6a4d5bc9b1e1 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:12.306550 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-60c74a67-a1bd-4a32-aefc-6a4d5bc9b1e1 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:12.307123 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-60c74a67-a1bd-4a32-aefc-6a4d5bc9b1e1 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:12.307731 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-60c74a67-a1bd-4a32-aefc-6a4d5bc9b1e1 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:12.308445 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-60c74a67-a1bd-4a32-aefc-6a4d5bc9b1e1 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:12.308863 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-60c74a67-a1bd-4a32-aefc-6a4d5bc9b1e1 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:12.387460 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-60c74a67-a1bd-4a32-aefc-6a4d5bc9b1e1 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:12.399935 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-60c74a67-a1bd-4a32-aefc-6a4d5bc9b1e1 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f" status: 200 len: 1210 microversion: 2.1 time: 0.102729 Nov 02 14:41:12.410139 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 105/212] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:12 2022] GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f => generated 1210 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:13.268788 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-8c1fe53a-bc51-4098-bdcd-b7c6acb3e93f tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:13.269518 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-8c1fe53a-bc51-4098-bdcd-b7c6acb3e93f tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 803e6b19-d962-4158-9a6c-e38cbd2b3e04] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:13.283256 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8c1fe53a-bc51-4098-bdcd-b7c6acb3e93f tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:13.283795 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8c1fe53a-bc51-4098-bdcd-b7c6acb3e93f tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:13.284247 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8c1fe53a-bc51-4098-bdcd-b7c6acb3e93f tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:13.286458 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8c1fe53a-bc51-4098-bdcd-b7c6acb3e93f tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:13.286458 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8c1fe53a-bc51-4098-bdcd-b7c6acb3e93f tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:13.286458 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8c1fe53a-bc51-4098-bdcd-b7c6acb3e93f tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:13.425079 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-774b2159-c00e-424d-a66f-49254e225351 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:13.426288 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-774b2159-c00e-424d-a66f-49254e225351 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: 400af7ba-398a-4908-8fea-f57eaa4e5a0f] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:13.433089 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-774b2159-c00e-424d-a66f-49254e225351 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:13.433831 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-774b2159-c00e-424d-a66f-49254e225351 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:13.434457 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-774b2159-c00e-424d-a66f-49254e225351 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:13.435420 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-774b2159-c00e-424d-a66f-49254e225351 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:13.435870 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-774b2159-c00e-424d-a66f-49254e225351 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:13.436526 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-774b2159-c00e-424d-a66f-49254e225351 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:13.637851 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-774b2159-c00e-424d-a66f-49254e225351 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:13.652093 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-774b2159-c00e-424d-a66f-49254e225351 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f" status: 200 len: 1274 microversion: 2.1 time: 0.232033 Nov 02 14:41:13.652966 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 106/213] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:13 2022] GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f => generated 1274 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:41:13.832966 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-8c1fe53a-bc51-4098-bdcd-b7c6acb3e93f tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:13.837321 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell1:SELECT=100 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:41:13.841644 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-8c1fe53a-bc51-4098-bdcd-b7c6acb3e93f tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04" status: 200 len: 1523 microversion: 2.1 time: 0.579151 Nov 02 14:41:13.842763 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 108/214] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:13 2022] GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04 => generated 1523 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:14.681110 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-8501917a-db33-4c74-af7a-730ae68908ca tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:14.681722 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-8501917a-db33-4c74-af7a-730ae68908ca tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: 400af7ba-398a-4908-8fea-f57eaa4e5a0f] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:14.698541 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8501917a-db33-4c74-af7a-730ae68908ca tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:14.699244 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8501917a-db33-4c74-af7a-730ae68908ca tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:14.699679 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8501917a-db33-4c74-af7a-730ae68908ca tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:14.700383 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8501917a-db33-4c74-af7a-730ae68908ca tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:14.701091 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8501917a-db33-4c74-af7a-730ae68908ca tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:14.701730 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8501917a-db33-4c74-af7a-730ae68908ca tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:14.869760 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-2cbc99e2-b8ee-400c-889b-036c8ed0b729 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:14.871606 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-2cbc99e2-b8ee-400c-889b-036c8ed0b729 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 803e6b19-d962-4158-9a6c-e38cbd2b3e04] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:14.881710 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2cbc99e2-b8ee-400c-889b-036c8ed0b729 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:14.882421 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2cbc99e2-b8ee-400c-889b-036c8ed0b729 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:14.883362 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2cbc99e2-b8ee-400c-889b-036c8ed0b729 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:14.884350 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2cbc99e2-b8ee-400c-889b-036c8ed0b729 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:14.885102 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2cbc99e2-b8ee-400c-889b-036c8ed0b729 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:14.885764 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2cbc99e2-b8ee-400c-889b-036c8ed0b729 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:14.887464 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-8501917a-db33-4c74-af7a-730ae68908ca tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:14.904829 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-8501917a-db33-4c74-af7a-730ae68908ca tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f" status: 200 len: 1314 microversion: 2.1 time: 0.227126 Nov 02 14:41:14.921707 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 107/215] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:14 2022] GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:15.067683 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-2cbc99e2-b8ee-400c-889b-036c8ed0b729 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:15.076401 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-2cbc99e2-b8ee-400c-889b-036c8ed0b729 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04" status: 200 len: 1523 microversion: 2.1 time: 0.212207 Nov 02 14:41:15.088958 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 109/216] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:14 2022] GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04 => generated 1523 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:15.929892 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-2a529d1f-76bb-419c-ae2e-fa0fcda71467 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:15.930495 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-2a529d1f-76bb-419c-ae2e-fa0fcda71467 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: 400af7ba-398a-4908-8fea-f57eaa4e5a0f] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:15.936934 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2a529d1f-76bb-419c-ae2e-fa0fcda71467 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:15.937490 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2a529d1f-76bb-419c-ae2e-fa0fcda71467 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:15.942023 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2a529d1f-76bb-419c-ae2e-fa0fcda71467 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:15.942023 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2a529d1f-76bb-419c-ae2e-fa0fcda71467 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:15.942023 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2a529d1f-76bb-419c-ae2e-fa0fcda71467 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:15.942023 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2a529d1f-76bb-419c-ae2e-fa0fcda71467 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:16.100556 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-2a529d1f-76bb-419c-ae2e-fa0fcda71467 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:16.100779 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-017ca875-087c-40ba-a264-3df313303241 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:16.101331 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-017ca875-087c-40ba-a264-3df313303241 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 803e6b19-d962-4158-9a6c-e38cbd2b3e04] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:16.109235 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-2a529d1f-76bb-419c-ae2e-fa0fcda71467 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f" status: 200 len: 1314 microversion: 2.1 time: 0.183056 Nov 02 14:41:16.110131 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 108/217] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:15 2022] GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:16.111288 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-017ca875-087c-40ba-a264-3df313303241 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:16.111888 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-017ca875-087c-40ba-a264-3df313303241 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:16.112337 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-017ca875-087c-40ba-a264-3df313303241 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:16.113087 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-017ca875-087c-40ba-a264-3df313303241 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:16.113692 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-017ca875-087c-40ba-a264-3df313303241 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:16.114269 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-017ca875-087c-40ba-a264-3df313303241 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:16.274665 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-017ca875-087c-40ba-a264-3df313303241 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:16.283539 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-017ca875-087c-40ba-a264-3df313303241 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04" status: 200 len: 1523 microversion: 2.1 time: 0.186697 Nov 02 14:41:16.284131 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 110/218] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:16 2022] GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04 => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:41:17.132615 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-7caf3723-e339-46c8-ab86-cc8b0dd15e76 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:17.133293 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-7caf3723-e339-46c8-ab86-cc8b0dd15e76 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: 400af7ba-398a-4908-8fea-f57eaa4e5a0f] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:17.139136 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7caf3723-e339-46c8-ab86-cc8b0dd15e76 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:17.139617 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7caf3723-e339-46c8-ab86-cc8b0dd15e76 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:17.140065 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7caf3723-e339-46c8-ab86-cc8b0dd15e76 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:17.140734 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7caf3723-e339-46c8-ab86-cc8b0dd15e76 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:17.141295 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7caf3723-e339-46c8-ab86-cc8b0dd15e76 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:17.141956 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7caf3723-e339-46c8-ab86-cc8b0dd15e76 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:17.273906 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-7caf3723-e339-46c8-ab86-cc8b0dd15e76 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:17.282946 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-7caf3723-e339-46c8-ab86-cc8b0dd15e76 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f" status: 200 len: 1314 microversion: 2.1 time: 0.153746 Nov 02 14:41:17.283652 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 109/219] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:17 2022] GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:17.309379 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-ad0dddb9-bb61-4c92-b61b-b8b6af7b2bfe tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:17.310108 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-ad0dddb9-bb61-4c92-b61b-b8b6af7b2bfe tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 803e6b19-d962-4158-9a6c-e38cbd2b3e04] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:17.316899 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ad0dddb9-bb61-4c92-b61b-b8b6af7b2bfe tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:17.317416 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ad0dddb9-bb61-4c92-b61b-b8b6af7b2bfe tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:17.317846 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ad0dddb9-bb61-4c92-b61b-b8b6af7b2bfe tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:17.318540 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ad0dddb9-bb61-4c92-b61b-b8b6af7b2bfe tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:17.319101 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ad0dddb9-bb61-4c92-b61b-b8b6af7b2bfe tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:17.319525 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ad0dddb9-bb61-4c92-b61b-b8b6af7b2bfe tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:17.399651 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-232a5455-49af-424b-bfd1-59b928e42857 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:17.400473 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-232a5455-49af-424b-bfd1-59b928e42857 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:17.406850 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-232a5455-49af-424b-bfd1-59b928e42857 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:17.407498 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-232a5455-49af-424b-bfd1-59b928e42857 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:17.408008 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-232a5455-49af-424b-bfd1-59b928e42857 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:17.408804 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-232a5455-49af-424b-bfd1-59b928e42857 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:17.409354 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-232a5455-49af-424b-bfd1-59b928e42857 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:17.409879 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-232a5455-49af-424b-bfd1-59b928e42857 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:17.458373 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-232a5455-49af-424b-bfd1-59b928e42857 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca/ips" status: 200 len: 152 microversion: 2.20 time: 0.062773 Nov 02 14:41:17.461207 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 110/220] 10.222.0.30 () {60 vars in 1289 bytes} [Wed Nov 2 14:41:17 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca/ips => generated 152 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 14:41:17.477929 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-ad0dddb9-bb61-4c92-b61b-b8b6af7b2bfe tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:17.488563 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-ad0dddb9-bb61-4c92-b61b-b8b6af7b2bfe tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04" status: 200 len: 1523 microversion: 2.1 time: 0.183409 Nov 02 14:41:17.494348 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 111/221] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:17 2022] GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04 => generated 1523 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:18.306729 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-feaea596-b73a-4a32-8598-19ff2d4d4651 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:18.307922 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-feaea596-b73a-4a32-8598-19ff2d4d4651 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: 400af7ba-398a-4908-8fea-f57eaa4e5a0f] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:18.313970 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-feaea596-b73a-4a32-8598-19ff2d4d4651 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:18.314605 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-feaea596-b73a-4a32-8598-19ff2d4d4651 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:18.315046 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-feaea596-b73a-4a32-8598-19ff2d4d4651 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:18.315902 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-feaea596-b73a-4a32-8598-19ff2d4d4651 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:18.316515 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-feaea596-b73a-4a32-8598-19ff2d4d4651 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:18.316941 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-feaea596-b73a-4a32-8598-19ff2d4d4651 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:18.504251 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-feaea596-b73a-4a32-8598-19ff2d4d4651 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:18.515605 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-feaea596-b73a-4a32-8598-19ff2d4d4651 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f" status: 200 len: 1314 microversion: 2.1 time: 0.212706 Nov 02 14:41:18.516180 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 111/222] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:18 2022] GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:18.526983 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-e5b1b590-ffd1-49b0-a398-6b8f79621ec0 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:18.527630 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-e5b1b590-ffd1-49b0-a398-6b8f79621ec0 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 803e6b19-d962-4158-9a6c-e38cbd2b3e04] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:18.534154 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e5b1b590-ffd1-49b0-a398-6b8f79621ec0 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:18.534814 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e5b1b590-ffd1-49b0-a398-6b8f79621ec0 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:18.536373 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e5b1b590-ffd1-49b0-a398-6b8f79621ec0 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:18.537115 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e5b1b590-ffd1-49b0-a398-6b8f79621ec0 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:18.537573 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e5b1b590-ffd1-49b0-a398-6b8f79621ec0 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:18.538003 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e5b1b590-ffd1-49b0-a398-6b8f79621ec0 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:18.587955 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [req-2af4aa8a-3177-4ecc-9781-127c266dac73 req-af399df3-f203-4d8b-8a61-ee2f672e3e81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "400af7ba-398a-4908-8fea-f57eaa4e5a0f", "tag": "c05cb546-bb19-48e2-bd44-b409f2203b29"}]} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:41:18.605795 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-2af4aa8a-3177-4ecc-9781-127c266dac73 req-af399df3-f203-4d8b-8a61-ee2f672e3e81 service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:18.606277 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-2af4aa8a-3177-4ecc-9781-127c266dac73 req-af399df3-f203-4d8b-8a61-ee2f672e3e81 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:18.606744 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-2af4aa8a-3177-4ecc-9781-127c266dac73 req-af399df3-f203-4d8b-8a61-ee2f672e3e81 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:18.630987 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.compute.server_external_events [req-2af4aa8a-3177-4ecc-9781-127c266dac73 req-af399df3-f203-4d8b-8a61-ee2f672e3e81 service nova] Creating event network-changed:c05cb546-bb19-48e2-bd44-b409f2203b29 for instance 400af7ba-398a-4908-8fea-f57eaa4e5a0f on hv-cinder-86236 Nov 02 14:41:18.639053 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [req-2af4aa8a-3177-4ecc-9781-127c266dac73 req-af399df3-f203-4d8b-8a61-ee2f672e3e81 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055433 Nov 02 14:41:18.642438 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 112/223] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:41:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:41:18.793189 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-e5b1b590-ffd1-49b0-a398-6b8f79621ec0 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:18.798393 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-e5b1b590-ffd1-49b0-a398-6b8f79621ec0 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04" status: 200 len: 1523 microversion: 2.1 time: 0.286537 Nov 02 14:41:18.803461 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 112/224] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:18 2022] GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04 => generated 1523 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:19.542359 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-ded95cde-4a76-45fd-9d2e-a5565e935f34 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:19.543646 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-ded95cde-4a76-45fd-9d2e-a5565e935f34 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: 400af7ba-398a-4908-8fea-f57eaa4e5a0f] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:19.550082 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ded95cde-4a76-45fd-9d2e-a5565e935f34 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:19.550796 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ded95cde-4a76-45fd-9d2e-a5565e935f34 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:19.551379 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ded95cde-4a76-45fd-9d2e-a5565e935f34 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:19.552257 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ded95cde-4a76-45fd-9d2e-a5565e935f34 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:19.553039 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ded95cde-4a76-45fd-9d2e-a5565e935f34 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:19.553703 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ded95cde-4a76-45fd-9d2e-a5565e935f34 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:19.796492 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-ded95cde-4a76-45fd-9d2e-a5565e935f34 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:19.807164 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-ded95cde-4a76-45fd-9d2e-a5565e935f34 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f" status: 200 len: 1314 microversion: 2.1 time: 0.268942 Nov 02 14:41:19.807695 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 113/225] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:19 2022] GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:19.824733 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-3ee3b4c2-2ad3-4205-81e5-f5ff9ad262b8 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:19.825378 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-3ee3b4c2-2ad3-4205-81e5-f5ff9ad262b8 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 803e6b19-d962-4158-9a6c-e38cbd2b3e04] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:19.847986 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3ee3b4c2-2ad3-4205-81e5-f5ff9ad262b8 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:19.848492 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3ee3b4c2-2ad3-4205-81e5-f5ff9ad262b8 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:19.848941 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3ee3b4c2-2ad3-4205-81e5-f5ff9ad262b8 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:19.851554 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3ee3b4c2-2ad3-4205-81e5-f5ff9ad262b8 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:19.852337 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3ee3b4c2-2ad3-4205-81e5-f5ff9ad262b8 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:19.852966 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3ee3b4c2-2ad3-4205-81e5-f5ff9ad262b8 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:19.911987 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell0:SELECT=2 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:41:19.938264 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell0:SELECT=6 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:41:20.130442 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-3ee3b4c2-2ad3-4205-81e5-f5ff9ad262b8 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:20.152034 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-3ee3b4c2-2ad3-4205-81e5-f5ff9ad262b8 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04" status: 200 len: 1523 microversion: 2.1 time: 0.322573 Nov 02 14:41:20.152034 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 113/226] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:19 2022] GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04 => generated 1523 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:20.831678 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-582e3e3d-c5b2-490b-b14e-44f612b6bcd8 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:20.833492 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-582e3e3d-c5b2-490b-b14e-44f612b6bcd8 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: 400af7ba-398a-4908-8fea-f57eaa4e5a0f] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:20.838964 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-582e3e3d-c5b2-490b-b14e-44f612b6bcd8 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:20.839466 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-582e3e3d-c5b2-490b-b14e-44f612b6bcd8 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:20.840551 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-582e3e3d-c5b2-490b-b14e-44f612b6bcd8 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:20.842902 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-582e3e3d-c5b2-490b-b14e-44f612b6bcd8 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:20.843390 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-582e3e3d-c5b2-490b-b14e-44f612b6bcd8 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:20.843841 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-582e3e3d-c5b2-490b-b14e-44f612b6bcd8 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:21.168023 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-16bd20d4-29d3-4d15-b06a-093a75b57dc6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:21.168799 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-16bd20d4-29d3-4d15-b06a-093a75b57dc6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 803e6b19-d962-4158-9a6c-e38cbd2b3e04] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:21.178918 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-16bd20d4-29d3-4d15-b06a-093a75b57dc6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:21.179402 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-16bd20d4-29d3-4d15-b06a-093a75b57dc6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:21.179832 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-16bd20d4-29d3-4d15-b06a-093a75b57dc6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:21.180554 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-16bd20d4-29d3-4d15-b06a-093a75b57dc6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:21.181030 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-16bd20d4-29d3-4d15-b06a-093a75b57dc6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:21.181442 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-16bd20d4-29d3-4d15-b06a-093a75b57dc6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:21.270598 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell0:SELECT=4 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:41:21.426233 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-582e3e3d-c5b2-490b-b14e-44f612b6bcd8 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:21.442391 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-582e3e3d-c5b2-490b-b14e-44f612b6bcd8 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f" status: 200 len: 1314 microversion: 2.1 time: 0.614198 Nov 02 14:41:21.443929 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 114/227] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:20 2022] GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f => generated 1314 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:21.573187 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-16bd20d4-29d3-4d15-b06a-093a75b57dc6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:21.583369 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-16bd20d4-29d3-4d15-b06a-093a75b57dc6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04" status: 200 len: 1523 microversion: 2.1 time: 0.419743 Nov 02 14:41:21.584220 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 114/228] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:21 2022] GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04 => generated 1523 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:22.475766 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-71aa5315-8e88-4468-b983-a9726214d5e4 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:22.476742 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-71aa5315-8e88-4468-b983-a9726214d5e4 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: 400af7ba-398a-4908-8fea-f57eaa4e5a0f] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:22.490241 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-71aa5315-8e88-4468-b983-a9726214d5e4 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:22.491544 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-71aa5315-8e88-4468-b983-a9726214d5e4 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:22.492965 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-71aa5315-8e88-4468-b983-a9726214d5e4 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:22.495192 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-71aa5315-8e88-4468-b983-a9726214d5e4 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:22.499217 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-71aa5315-8e88-4468-b983-a9726214d5e4 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:22.500034 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-71aa5315-8e88-4468-b983-a9726214d5e4 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:22.609095 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-cdc6726c-0b76-4347-bae9-6afc0cd6829b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:22.609719 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-cdc6726c-0b76-4347-bae9-6afc0cd6829b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 803e6b19-d962-4158-9a6c-e38cbd2b3e04] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:22.622488 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-cdc6726c-0b76-4347-bae9-6afc0cd6829b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:22.622980 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-cdc6726c-0b76-4347-bae9-6afc0cd6829b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:22.623450 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-cdc6726c-0b76-4347-bae9-6afc0cd6829b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:22.624133 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-cdc6726c-0b76-4347-bae9-6afc0cd6829b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:22.624598 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-cdc6726c-0b76-4347-bae9-6afc0cd6829b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:22.629636 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-cdc6726c-0b76-4347-bae9-6afc0cd6829b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:22.742617 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-71aa5315-8e88-4468-b983-a9726214d5e4 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:22.759195 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-71aa5315-8e88-4468-b983-a9726214d5e4 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f" status: 200 len: 1314 microversion: 2.1 time: 0.292429 Nov 02 14:41:22.759784 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 115/229] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:22 2022] GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:22.864944 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-cdc6726c-0b76-4347-bae9-6afc0cd6829b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:22.876212 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-cdc6726c-0b76-4347-bae9-6afc0cd6829b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04" status: 200 len: 1523 microversion: 2.1 time: 0.271664 Nov 02 14:41:22.878829 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 115/230] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:22 2022] GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04 => generated 1523 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:23.103250 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-7f136ddb-8774-44af-bc92-cc8a13a86172 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:41:23.103356 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-7f136ddb-8774-44af-bc92-cc8a13a86172 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:23.109993 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7f136ddb-8774-44af-bc92-cc8a13a86172 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:23.111521 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7f136ddb-8774-44af-bc92-cc8a13a86172 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:23.112400 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7f136ddb-8774-44af-bc92-cc8a13a86172 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:23.113374 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7f136ddb-8774-44af-bc92-cc8a13a86172 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:23.113834 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7f136ddb-8774-44af-bc92-cc8a13a86172 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:23.114275 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7f136ddb-8774-44af-bc92-cc8a13a86172 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:23.133192 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:41:23.139157 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.objects.instance [None req-7f136ddb-8774-44af-bc92-cc8a13a86172 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lazy-loading 'flavor' on Instance uuid 5d0f8129-8155-4b7c-a462-f9c067ecfbca {{(pid=119658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:41:23.767113 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-7f136ddb-8774-44af-bc92-cc8a13a86172 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "POST /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca/action" status: 202 len: 0 microversion: 2.20 time: 0.668524 Nov 02 14:41:23.770961 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 116/231] 10.222.0.30 () {62 vars in 1319 bytes} [Wed Nov 2 14:41:23 2022] POST /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca/action => generated 0 bytes in 670 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:41:23.776326 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-6771188f-e5d1-4515-aed4-cf03772619e7 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:23.776929 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-6771188f-e5d1-4515-aed4-cf03772619e7 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:23.785987 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6771188f-e5d1-4515-aed4-cf03772619e7 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:23.786464 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6771188f-e5d1-4515-aed4-cf03772619e7 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:23.786899 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6771188f-e5d1-4515-aed4-cf03772619e7 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:23.787588 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6771188f-e5d1-4515-aed4-cf03772619e7 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:23.788034 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6771188f-e5d1-4515-aed4-cf03772619e7 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:23.788450 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6771188f-e5d1-4515-aed4-cf03772619e7 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:23.806258 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-a5c21aaa-2ac5-4a4f-928b-7bf1f81e2002 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:23.808916 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-a5c21aaa-2ac5-4a4f-928b-7bf1f81e2002 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: 400af7ba-398a-4908-8fea-f57eaa4e5a0f] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:23.828992 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a5c21aaa-2ac5-4a4f-928b-7bf1f81e2002 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:23.829734 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a5c21aaa-2ac5-4a4f-928b-7bf1f81e2002 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:23.830927 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a5c21aaa-2ac5-4a4f-928b-7bf1f81e2002 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:23.831905 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a5c21aaa-2ac5-4a4f-928b-7bf1f81e2002 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:23.832475 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a5c21aaa-2ac5-4a4f-928b-7bf1f81e2002 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:23.833646 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a5c21aaa-2ac5-4a4f-928b-7bf1f81e2002 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:24.069424 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-6771188f-e5d1-4515-aed4-cf03772619e7 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:24.072155 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-a5c21aaa-2ac5-4a4f-928b-7bf1f81e2002 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:24.080543 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-6771188f-e5d1-4515-aed4-cf03772619e7 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:24.080891 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-a5c21aaa-2ac5-4a4f-928b-7bf1f81e2002 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f" status: 200 len: 1314 microversion: 2.1 time: 0.298178 Nov 02 14:41:24.082676 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-6771188f-e5d1-4515-aed4-cf03772619e7 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:24.086985 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-6771188f-e5d1-4515-aed4-cf03772619e7 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1724 microversion: 2.20 time: 0.314792 Nov 02 14:41:24.088093 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 116/232] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:41:23 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1724 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:41:24.093229 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-79df24b2-b344-4a5d-9a87-4983715e6688 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:24.094071 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-79df24b2-b344-4a5d-9a87-4983715e6688 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 803e6b19-d962-4158-9a6c-e38cbd2b3e04] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:24.097387 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 117/233] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:23 2022] GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f => generated 1314 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:24.102970 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-79df24b2-b344-4a5d-9a87-4983715e6688 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:24.103648 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-79df24b2-b344-4a5d-9a87-4983715e6688 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:24.105077 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-79df24b2-b344-4a5d-9a87-4983715e6688 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:24.106923 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-79df24b2-b344-4a5d-9a87-4983715e6688 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:24.107542 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-79df24b2-b344-4a5d-9a87-4983715e6688 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:24.108259 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-79df24b2-b344-4a5d-9a87-4983715e6688 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:24.285865 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-79df24b2-b344-4a5d-9a87-4983715e6688 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:24.294666 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-79df24b2-b344-4a5d-9a87-4983715e6688 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04" status: 200 len: 1523 microversion: 2.1 time: 0.205209 Nov 02 14:41:24.295231 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 117/234] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:24 2022] GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04 => generated 1523 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:25.104398 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-8509ae02-2551-43ce-a13a-763ace6946fd tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:25.105454 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-8509ae02-2551-43ce-a13a-763ace6946fd tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: 400af7ba-398a-4908-8fea-f57eaa4e5a0f] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:25.116696 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-45cd34ef-a323-46f3-9be2-dfbcdf0b7333 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:25.117325 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-45cd34ef-a323-46f3-9be2-dfbcdf0b7333 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:25.124351 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8509ae02-2551-43ce-a13a-763ace6946fd tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:25.126913 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-45cd34ef-a323-46f3-9be2-dfbcdf0b7333 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:25.127629 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8509ae02-2551-43ce-a13a-763ace6946fd tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:25.128063 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8509ae02-2551-43ce-a13a-763ace6946fd tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:25.128955 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8509ae02-2551-43ce-a13a-763ace6946fd tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:25.129459 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8509ae02-2551-43ce-a13a-763ace6946fd tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:25.132104 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-45cd34ef-a323-46f3-9be2-dfbcdf0b7333 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:25.132104 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-45cd34ef-a323-46f3-9be2-dfbcdf0b7333 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:25.132104 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-45cd34ef-a323-46f3-9be2-dfbcdf0b7333 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:25.132104 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-45cd34ef-a323-46f3-9be2-dfbcdf0b7333 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:25.132667 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-45cd34ef-a323-46f3-9be2-dfbcdf0b7333 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:25.133634 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8509ae02-2551-43ce-a13a-763ace6946fd tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:25.357139 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-45cd34ef-a323-46f3-9be2-dfbcdf0b7333 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:25.364089 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-8509ae02-2551-43ce-a13a-763ace6946fd tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:25.366072 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-45cd34ef-a323-46f3-9be2-dfbcdf0b7333 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:25.367525 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-45cd34ef-a323-46f3-9be2-dfbcdf0b7333 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:25.368682 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-45cd34ef-a323-46f3-9be2-dfbcdf0b7333 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1724 microversion: 2.20 time: 0.256165 Nov 02 14:41:25.369284 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 118/235] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:41:25 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1724 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:41:25.372784 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-8509ae02-2551-43ce-a13a-763ace6946fd tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f" status: 200 len: 1314 microversion: 2.1 time: 0.272333 Nov 02 14:41:25.372784 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 118/236] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:25 2022] GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:25.373777 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-e4f9d324-92f8-4e7e-9997-8193b93ee4f6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:25.374355 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-e4f9d324-92f8-4e7e-9997-8193b93ee4f6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 803e6b19-d962-4158-9a6c-e38cbd2b3e04] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:25.380551 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e4f9d324-92f8-4e7e-9997-8193b93ee4f6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:25.381217 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e4f9d324-92f8-4e7e-9997-8193b93ee4f6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:25.381704 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e4f9d324-92f8-4e7e-9997-8193b93ee4f6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:25.382397 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e4f9d324-92f8-4e7e-9997-8193b93ee4f6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:25.382850 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e4f9d324-92f8-4e7e-9997-8193b93ee4f6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:25.383270 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e4f9d324-92f8-4e7e-9997-8193b93ee4f6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:25.530020 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-e4f9d324-92f8-4e7e-9997-8193b93ee4f6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:25.538780 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-e4f9d324-92f8-4e7e-9997-8193b93ee4f6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04" status: 200 len: 1523 microversion: 2.1 time: 0.168522 Nov 02 14:41:25.539358 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 119/237] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:25 2022] GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:26.402579 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-778a3e32-92f7-42eb-a117-cbcb7a680e3f tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:26.404038 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-46121f04-10b9-424e-97f9-89cbcf07c8bc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:26.405072 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-46121f04-10b9-424e-97f9-89cbcf07c8bc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:26.406959 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-778a3e32-92f7-42eb-a117-cbcb7a680e3f tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: 400af7ba-398a-4908-8fea-f57eaa4e5a0f] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:26.421600 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-46121f04-10b9-424e-97f9-89cbcf07c8bc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:26.422154 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-46121f04-10b9-424e-97f9-89cbcf07c8bc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:26.422608 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-46121f04-10b9-424e-97f9-89cbcf07c8bc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:26.425939 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-778a3e32-92f7-42eb-a117-cbcb7a680e3f tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:26.426782 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-778a3e32-92f7-42eb-a117-cbcb7a680e3f tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:26.427362 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-778a3e32-92f7-42eb-a117-cbcb7a680e3f tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:26.428468 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-778a3e32-92f7-42eb-a117-cbcb7a680e3f tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:26.429111 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-778a3e32-92f7-42eb-a117-cbcb7a680e3f tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:26.430221 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-46121f04-10b9-424e-97f9-89cbcf07c8bc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:26.431428 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-46121f04-10b9-424e-97f9-89cbcf07c8bc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:26.432096 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-46121f04-10b9-424e-97f9-89cbcf07c8bc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:26.434499 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-778a3e32-92f7-42eb-a117-cbcb7a680e3f tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:26.705071 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-46121f04-10b9-424e-97f9-89cbcf07c8bc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:26.715952 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-46121f04-10b9-424e-97f9-89cbcf07c8bc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:26.721858 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-46121f04-10b9-424e-97f9-89cbcf07c8bc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:26.723305 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-46121f04-10b9-424e-97f9-89cbcf07c8bc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1724 microversion: 2.20 time: 0.332367 Nov 02 14:41:26.736909 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 119/238] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:41:26 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1724 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:41:26.749257 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-9466694c-0d30-46c4-ab8c-249514293cb7 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:26.751943 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-9466694c-0d30-46c4-ab8c-249514293cb7 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 803e6b19-d962-4158-9a6c-e38cbd2b3e04] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:26.758681 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9466694c-0d30-46c4-ab8c-249514293cb7 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:26.759424 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9466694c-0d30-46c4-ab8c-249514293cb7 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:26.760013 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9466694c-0d30-46c4-ab8c-249514293cb7 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:26.760937 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9466694c-0d30-46c4-ab8c-249514293cb7 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:26.761625 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9466694c-0d30-46c4-ab8c-249514293cb7 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:26.762197 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9466694c-0d30-46c4-ab8c-249514293cb7 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:26.859398 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-778a3e32-92f7-42eb-a117-cbcb7a680e3f tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:26.869210 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-778a3e32-92f7-42eb-a117-cbcb7a680e3f tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f" status: 200 len: 1314 microversion: 2.1 time: 0.476906 Nov 02 14:41:26.869834 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 120/239] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:26 2022] GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f => generated 1314 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:27.023169 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-9466694c-0d30-46c4-ab8c-249514293cb7 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:27.032104 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-9466694c-0d30-46c4-ab8c-249514293cb7 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04" status: 200 len: 1523 microversion: 2.1 time: 0.293759 Nov 02 14:41:27.040774 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 120/240] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:26 2022] GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04 => generated 1523 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:27.755850 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-0201c320-6a0a-40b7-bc27-c21663e643c0 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:27.763352 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-0201c320-6a0a-40b7-bc27-c21663e643c0 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:27.771377 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0201c320-6a0a-40b7-bc27-c21663e643c0 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:27.772265 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0201c320-6a0a-40b7-bc27-c21663e643c0 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:27.772922 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0201c320-6a0a-40b7-bc27-c21663e643c0 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:27.774173 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0201c320-6a0a-40b7-bc27-c21663e643c0 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:27.774846 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0201c320-6a0a-40b7-bc27-c21663e643c0 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:27.775522 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0201c320-6a0a-40b7-bc27-c21663e643c0 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:27.897247 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-fe27b8c2-853b-4538-9c66-821f2ad5efd3 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:27.897853 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-fe27b8c2-853b-4538-9c66-821f2ad5efd3 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: 400af7ba-398a-4908-8fea-f57eaa4e5a0f] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:27.908716 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-fe27b8c2-853b-4538-9c66-821f2ad5efd3 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:27.910244 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-fe27b8c2-853b-4538-9c66-821f2ad5efd3 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:27.910942 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-fe27b8c2-853b-4538-9c66-821f2ad5efd3 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:27.913073 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-fe27b8c2-853b-4538-9c66-821f2ad5efd3 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:27.914079 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-fe27b8c2-853b-4538-9c66-821f2ad5efd3 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:27.914449 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-fe27b8c2-853b-4538-9c66-821f2ad5efd3 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:28.086082 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-0201c320-6a0a-40b7-bc27-c21663e643c0 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:28.100237 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-0201c320-6a0a-40b7-bc27-c21663e643c0 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:28.105482 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-0201c320-6a0a-40b7-bc27-c21663e643c0 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:28.109483 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-0201c320-6a0a-40b7-bc27-c21663e643c0 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1724 microversion: 2.20 time: 0.357396 Nov 02 14:41:28.110073 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 121/241] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:41:27 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1724 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:41:28.145716 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-7f0f66f1-9546-4d1c-ba5a-51ba1c539512 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:28.151958 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-7f0f66f1-9546-4d1c-ba5a-51ba1c539512 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 803e6b19-d962-4158-9a6c-e38cbd2b3e04] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:28.154387 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-fe27b8c2-853b-4538-9c66-821f2ad5efd3 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:28.168796 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7f0f66f1-9546-4d1c-ba5a-51ba1c539512 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:28.168905 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-fe27b8c2-853b-4538-9c66-821f2ad5efd3 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f" status: 200 len: 1314 microversion: 2.1 time: 0.273366 Nov 02 14:41:28.168989 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7f0f66f1-9546-4d1c-ba5a-51ba1c539512 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:28.168989 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7f0f66f1-9546-4d1c-ba5a-51ba1c539512 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:28.168989 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7f0f66f1-9546-4d1c-ba5a-51ba1c539512 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:28.169270 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7f0f66f1-9546-4d1c-ba5a-51ba1c539512 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:28.169495 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7f0f66f1-9546-4d1c-ba5a-51ba1c539512 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:28.169777 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 121/242] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:27 2022] GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:41:28.358890 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-7f0f66f1-9546-4d1c-ba5a-51ba1c539512 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:28.370359 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-7f0f66f1-9546-4d1c-ba5a-51ba1c539512 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04" status: 200 len: 1523 microversion: 2.1 time: 0.244227 Nov 02 14:41:28.371285 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 122/243] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:28 2022] GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04 => generated 1523 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:29.139976 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-896796d1-438f-4256-afd4-c64a43966385 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:29.140595 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-896796d1-438f-4256-afd4-c64a43966385 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:29.148437 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-896796d1-438f-4256-afd4-c64a43966385 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:29.150510 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-896796d1-438f-4256-afd4-c64a43966385 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:29.150944 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-896796d1-438f-4256-afd4-c64a43966385 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:29.152029 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-896796d1-438f-4256-afd4-c64a43966385 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:29.152482 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-896796d1-438f-4256-afd4-c64a43966385 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:29.152911 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-896796d1-438f-4256-afd4-c64a43966385 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:29.206067 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-001e9fea-d4f8-459c-a07c-72ae71629ba0 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:29.212913 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-001e9fea-d4f8-459c-a07c-72ae71629ba0 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: 400af7ba-398a-4908-8fea-f57eaa4e5a0f] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:29.234712 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-001e9fea-d4f8-459c-a07c-72ae71629ba0 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:29.236088 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-001e9fea-d4f8-459c-a07c-72ae71629ba0 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:29.236831 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-001e9fea-d4f8-459c-a07c-72ae71629ba0 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:29.241384 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-001e9fea-d4f8-459c-a07c-72ae71629ba0 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:29.242230 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-001e9fea-d4f8-459c-a07c-72ae71629ba0 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:29.247142 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-001e9fea-d4f8-459c-a07c-72ae71629ba0 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:29.567932 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-896796d1-438f-4256-afd4-c64a43966385 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:29.581974 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-896796d1-438f-4256-afd4-c64a43966385 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:29.590441 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-896796d1-438f-4256-afd4-c64a43966385 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:29.595408 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-896796d1-438f-4256-afd4-c64a43966385 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1724 microversion: 2.20 time: 0.458038 Nov 02 14:41:29.596938 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 122/244] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:41:29 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1724 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:41:29.606956 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-df6ace46-3e97-4b06-b5a2-255ad510f8e0 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:29.608476 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-df6ace46-3e97-4b06-b5a2-255ad510f8e0 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 803e6b19-d962-4158-9a6c-e38cbd2b3e04] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:29.623819 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-df6ace46-3e97-4b06-b5a2-255ad510f8e0 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:29.624743 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-df6ace46-3e97-4b06-b5a2-255ad510f8e0 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:29.630003 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-df6ace46-3e97-4b06-b5a2-255ad510f8e0 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:29.637849 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-df6ace46-3e97-4b06-b5a2-255ad510f8e0 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:29.637849 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-df6ace46-3e97-4b06-b5a2-255ad510f8e0 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:29.637849 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-df6ace46-3e97-4b06-b5a2-255ad510f8e0 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:29.638156 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-001e9fea-d4f8-459c-a07c-72ae71629ba0 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:29.649926 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-001e9fea-d4f8-459c-a07c-72ae71629ba0 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f" status: 200 len: 1314 microversion: 2.1 time: 0.454038 Nov 02 14:41:29.666355 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 123/245] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:29 2022] GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f => generated 1314 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:29.810091 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-df6ace46-3e97-4b06-b5a2-255ad510f8e0 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:29.823556 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-df6ace46-3e97-4b06-b5a2-255ad510f8e0 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04" status: 200 len: 1523 microversion: 2.1 time: 0.219864 Nov 02 14:41:29.825042 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 123/246] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:29 2022] GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04 => generated 1523 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:30.626093 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-8360333b-6818-4470-b55a-c34205445963 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:30.627727 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-8360333b-6818-4470-b55a-c34205445963 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:30.634890 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8360333b-6818-4470-b55a-c34205445963 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:30.635714 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8360333b-6818-4470-b55a-c34205445963 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:30.636416 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8360333b-6818-4470-b55a-c34205445963 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:30.637309 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8360333b-6818-4470-b55a-c34205445963 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:30.637970 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8360333b-6818-4470-b55a-c34205445963 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:30.638548 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8360333b-6818-4470-b55a-c34205445963 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:30.674492 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-cb0b653d-1535-441f-8eea-c149d5358be8 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:30.675145 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-cb0b653d-1535-441f-8eea-c149d5358be8 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: 400af7ba-398a-4908-8fea-f57eaa4e5a0f] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:30.701858 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-cb0b653d-1535-441f-8eea-c149d5358be8 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:30.702379 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-cb0b653d-1535-441f-8eea-c149d5358be8 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:30.702827 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-cb0b653d-1535-441f-8eea-c149d5358be8 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:30.703548 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-cb0b653d-1535-441f-8eea-c149d5358be8 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:30.704020 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-cb0b653d-1535-441f-8eea-c149d5358be8 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:30.704480 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-cb0b653d-1535-441f-8eea-c149d5358be8 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:30.943390 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-8360333b-6818-4470-b55a-c34205445963 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:30.965585 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-8360333b-6818-4470-b55a-c34205445963 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:30.970952 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-8360333b-6818-4470-b55a-c34205445963 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:30.973959 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-8360333b-6818-4470-b55a-c34205445963 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1724 microversion: 2.20 time: 0.352146 Nov 02 14:41:30.986958 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 124/247] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:41:30 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1724 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:41:31.000173 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-31a94b9d-2170-4997-a731-236b6dda5614 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:31.000173 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-31a94b9d-2170-4997-a731-236b6dda5614 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 803e6b19-d962-4158-9a6c-e38cbd2b3e04] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:31.034693 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-31a94b9d-2170-4997-a731-236b6dda5614 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:31.035582 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-31a94b9d-2170-4997-a731-236b6dda5614 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:31.038550 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-31a94b9d-2170-4997-a731-236b6dda5614 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:31.040548 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-31a94b9d-2170-4997-a731-236b6dda5614 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:31.041820 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-31a94b9d-2170-4997-a731-236b6dda5614 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:31.045913 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-31a94b9d-2170-4997-a731-236b6dda5614 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:31.100796 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell1:SELECT=100 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:41:31.160969 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-cb0b653d-1535-441f-8eea-c149d5358be8 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:31.176128 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-cb0b653d-1535-441f-8eea-c149d5358be8 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f" status: 200 len: 1314 microversion: 2.1 time: 0.505140 Nov 02 14:41:31.184368 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 124/248] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:30 2022] GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f => generated 1314 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:31.284194 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [req-3d812246-feb8-49d9-9c7e-325af51bbf94 req-768e6fdd-05f0-4ed4-ae34-97253790d06a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "400af7ba-398a-4908-8fea-f57eaa4e5a0f", "name": "network-vif-plugged", "status": "completed", "tag": "c05cb546-bb19-48e2-bd44-b409f2203b29"}]} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:41:31.306959 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-3d812246-feb8-49d9-9c7e-325af51bbf94 req-768e6fdd-05f0-4ed4-ae34-97253790d06a service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:31.309863 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-3d812246-feb8-49d9-9c7e-325af51bbf94 req-768e6fdd-05f0-4ed4-ae34-97253790d06a service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:31.309863 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-3d812246-feb8-49d9-9c7e-325af51bbf94 req-768e6fdd-05f0-4ed4-ae34-97253790d06a service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:31.351442 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.compute.server_external_events [req-3d812246-feb8-49d9-9c7e-325af51bbf94 req-768e6fdd-05f0-4ed4-ae34-97253790d06a service nova] Creating event network-vif-plugged:c05cb546-bb19-48e2-bd44-b409f2203b29 for instance 400af7ba-398a-4908-8fea-f57eaa4e5a0f on hv-cinder-86236 Nov 02 14:41:31.371219 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [req-3d812246-feb8-49d9-9c7e-325af51bbf94 req-768e6fdd-05f0-4ed4-ae34-97253790d06a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087653 Nov 02 14:41:31.375316 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 125/249] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:41:31.416544 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-31a94b9d-2170-4997-a731-236b6dda5614 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:31.428674 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-31a94b9d-2170-4997-a731-236b6dda5614 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04" status: 200 len: 1503 microversion: 2.1 time: 0.440045 Nov 02 14:41:31.430539 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 125/250] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:30 2022] GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04 => generated 1503 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:31.463380 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-a17d3192-d67c-444f-b3e1-2d00fb4e0b07 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "65042201-d673-421d-a2eb-106190b77fca"}} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:41:31.467030 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-a17d3192-d67c-444f-b3e1-2d00fb4e0b07 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 803e6b19-d962-4158-9a6c-e38cbd2b3e04] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:31.482768 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a17d3192-d67c-444f-b3e1-2d00fb4e0b07 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:31.486155 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a17d3192-d67c-444f-b3e1-2d00fb4e0b07 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:31.486826 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a17d3192-d67c-444f-b3e1-2d00fb4e0b07 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:31.491106 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a17d3192-d67c-444f-b3e1-2d00fb4e0b07 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:31.492008 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a17d3192-d67c-444f-b3e1-2d00fb4e0b07 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:31.492766 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a17d3192-d67c-444f-b3e1-2d00fb4e0b07 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:31.553561 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.wsgi [None req-a17d3192-d67c-444f-b3e1-2d00fb4e0b07 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] HTTP exception thrown: Cannot 'attach_volume' instance 803e6b19-d962-4158-9a6c-e38cbd2b3e04 while it is in vm_state rescued Nov 02 14:41:31.558432 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-a17d3192-d67c-444f-b3e1-2d00fb4e0b07 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Request method failure captured: Nov 02 14:41:31.558432 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: request: POST /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04/os-volume_attachments HTTP/1.1 Nov 02 14:41:31.558432 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Accept: application/json Nov 02 14:41:31.558432 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Accept-Encoding: identity Nov 02 14:41:31.558432 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Connection: close Nov 02 14:41:31.558432 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Content-Length: 74 Nov 02 14:41:31.558432 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Content-Type: application/json Nov 02 14:41:31.558432 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Host: 10.222.0.30 Nov 02 14:41:31.558432 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Openstack-System-Scope: None Nov 02 14:41:31.558432 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: User-Agent: python-urllib3/1.26.12 Nov 02 14:41:31.558432 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Auth-Token: gAAAAABjYoEkmtPFFndA3pI-hOMfV7WeoZBKhAJ-580_WIi7mvkfUXB_maVp8Mt8Up4K9l56kfyts_G8Q7rNjcSVvl07EMxmG19Ns5oBN2S0eWoNg7Mp3X9Xfyoe_HCMO3EwwbvsyRXXHW6uAL6g6f3-FqHT3Vo42Jex2zLZydCgw7GbTD2dulA Nov 02 14:41:31.558432 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Domain-Id: None Nov 02 14:41:31.558432 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Domain-Name: None Nov 02 14:41:31.558432 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Identity-Status: Confirmed Nov 02 14:41:31.558432 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Is-Admin-Project: True Nov 02 14:41:31.558432 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Domain-Id: default Nov 02 14:41:31.558432 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Domain-Name: Default Nov 02 14:41:31.558432 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Id: edc675d4a92f4ff9ae8a41a020fa792c Nov 02 14:41:31.558432 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-978907565 Nov 02 14:41:31.558432 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Role: reader,member Nov 02 14:41:31.558432 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Roles: reader,member Nov 02 14:41:31.559941 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/edc675d4a92f4ff9ae8a41a020fa792c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/edc675d4a92f4ff9ae8a41a020fa792c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/edc675d4a92f4ff9ae8a41a020fa792c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_edc675d4a92f4ff9ae8a41a020fa792c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:41:31.559941 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant: tempest-ServerRescueNegativeTestJSON-978907565 Nov 02 14:41:31.559941 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant-Id: edc675d4a92f4ff9ae8a41a020fa792c Nov 02 14:41:31.559941 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-978907565 Nov 02 14:41:31.559941 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User: tempest-ServerRescueNegativeTestJSON-978907565-project Nov 02 14:41:31.559941 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Domain-Id: default Nov 02 14:41:31.559941 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Domain-Name: Default Nov 02 14:41:31.559941 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Id: 921ba33e2e0740278b7b6fb4af248363 Nov 02 14:41:31.559941 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Name: tempest-ServerRescueNegativeTestJSON-978907565-project Nov 02 14:41:31.559941 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Nov 02 14:41:31.559941 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: {"volumeAttachment": {"volumeId": "65042201-d673-421d-a2eb-106190b77fca"}} Nov 02 14:41:31.559941 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: method: > Nov 02 14:41:31.561121 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: exception: Cannot 'attach_volume' instance 803e6b19-d962-4158-9a6c-e38cbd2b3e04 while it is in vm_state rescued Nov 02 14:41:31.561121 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: action_args: {'server_id': '803e6b19-d962-4158-9a6c-e38cbd2b3e04', 'body': {'volumeAttachment': {'volumeId': '65042201-d673-421d-a2eb-106190b77fca'}}} Nov 02 14:41:31.561121 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:41:31.561121 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:41:31.561121 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Nov 02 14:41:31.561121 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Nov 02 14:41:31.561121 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 14:41:31.561121 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 14:41:31.561121 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 14:41:31.561121 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 14:41:31.561121 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 803e6b19-d962-4158-9a6c-e38cbd2b3e04 in vm_state rescued. Cannot attach_volume while the instance is in this state. Nov 02 14:41:31.561121 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:41:31.561121 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:41:31.561121 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:41:31.561121 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:41:31.561121 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:41:31.561121 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:41:31.561121 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:41:31.561121 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:41:31.562526 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:41:31.562526 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:41:31.562526 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:41:31.562526 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:41:31.562526 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:41:31.562526 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:41:31.562526 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:41:31.562526 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:41:31.562526 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Nov 02 14:41:31.562526 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 14:41:31.562526 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 14:41:31.562526 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 14:41:31.562526 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 803e6b19-d962-4158-9a6c-e38cbd2b3e04 while it is in vm_state rescued Nov 02 14:41:31.562526 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:41:31.562526 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:41:31.562526 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:41:31.562526 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:41:31.562526 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:41:31.562526 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:41:31.564418 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:41:31.564418 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:41:31.564418 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 803e6b19-d962-4158-9a6c-e38cbd2b3e04 while it is in vm_state rescued Nov 02 14:41:31.564418 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:41:31.565769 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-a17d3192-d67c-444f-b3e1-2d00fb4e0b07 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Returning 409 to user: Cannot 'attach_volume' instance 803e6b19-d962-4158-9a6c-e38cbd2b3e04 while it is in vm_state rescued {{(pid=119658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:41:31.575371 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-a17d3192-d67c-444f-b3e1-2d00fb4e0b07 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "POST /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.108065 Nov 02 14:41:31.575371 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 126/251] 10.222.0.30 () {60 vars in 1323 bytes} [Wed Nov 2 14:41:31 2022] POST /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04/os-volume_attachments => generated 152 bytes in 113 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 14:41:31.577632 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-3898b432-61c0-4a71-aa2c-93a4ab5576e0 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:41:31.578407 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-3898b432-61c0-4a71-aa2c-93a4ab5576e0 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 803e6b19-d962-4158-9a6c-e38cbd2b3e04] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:31.607507 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3898b432-61c0-4a71-aa2c-93a4ab5576e0 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:31.608021 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3898b432-61c0-4a71-aa2c-93a4ab5576e0 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:31.608463 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3898b432-61c0-4a71-aa2c-93a4ab5576e0 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:31.611756 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3898b432-61c0-4a71-aa2c-93a4ab5576e0 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:31.612268 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3898b432-61c0-4a71-aa2c-93a4ab5576e0 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:31.619522 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3898b432-61c0-4a71-aa2c-93a4ab5576e0 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:31.876236 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-3898b432-61c0-4a71-aa2c-93a4ab5576e0 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "POST /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04/action" status: 202 len: 0 microversion: 2.1 time: 0.303216 Nov 02 14:41:31.880449 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 126/252] 10.222.0.30 () {60 vars in 1278 bytes} [Wed Nov 2 14:41:31 2022] POST /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04/action => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 14:41:31.885663 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-1283fa5c-9389-4555-9d25-070d84811547 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:31.886839 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-1283fa5c-9389-4555-9d25-070d84811547 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 803e6b19-d962-4158-9a6c-e38cbd2b3e04] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:31.894264 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1283fa5c-9389-4555-9d25-070d84811547 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:31.895003 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1283fa5c-9389-4555-9d25-070d84811547 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:31.895674 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1283fa5c-9389-4555-9d25-070d84811547 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:31.896387 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1283fa5c-9389-4555-9d25-070d84811547 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:31.896843 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1283fa5c-9389-4555-9d25-070d84811547 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:31.897307 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1283fa5c-9389-4555-9d25-070d84811547 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:32.011228 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-bc644090-922e-43b7-b26d-4e832e1307c4 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:32.011971 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-bc644090-922e-43b7-b26d-4e832e1307c4 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:32.019207 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-bc644090-922e-43b7-b26d-4e832e1307c4 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:32.019935 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-bc644090-922e-43b7-b26d-4e832e1307c4 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:32.020550 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-bc644090-922e-43b7-b26d-4e832e1307c4 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:32.021276 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-bc644090-922e-43b7-b26d-4e832e1307c4 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:32.021718 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-bc644090-922e-43b7-b26d-4e832e1307c4 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:32.022303 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-bc644090-922e-43b7-b26d-4e832e1307c4 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:32.072786 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-1283fa5c-9389-4555-9d25-070d84811547 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:32.087062 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-1283fa5c-9389-4555-9d25-070d84811547 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04" status: 200 len: 1511 microversion: 2.1 time: 0.203517 Nov 02 14:41:32.087062 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 127/253] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:31 2022] GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04 => generated 1511 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:32.211385 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-62520101-0501-4259-9f2e-243c2f35f3c4 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:32.212426 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-62520101-0501-4259-9f2e-243c2f35f3c4 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: 400af7ba-398a-4908-8fea-f57eaa4e5a0f] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:32.237196 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-62520101-0501-4259-9f2e-243c2f35f3c4 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:32.241416 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-62520101-0501-4259-9f2e-243c2f35f3c4 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:32.243541 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-62520101-0501-4259-9f2e-243c2f35f3c4 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:32.244505 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-62520101-0501-4259-9f2e-243c2f35f3c4 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:32.248938 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-62520101-0501-4259-9f2e-243c2f35f3c4 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:32.249283 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-bc644090-922e-43b7-b26d-4e832e1307c4 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:32.251601 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-62520101-0501-4259-9f2e-243c2f35f3c4 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:32.259923 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-bc644090-922e-43b7-b26d-4e832e1307c4 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:32.261827 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-bc644090-922e-43b7-b26d-4e832e1307c4 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:32.263254 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-bc644090-922e-43b7-b26d-4e832e1307c4 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1724 microversion: 2.20 time: 0.256341 Nov 02 14:41:32.265037 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 127/254] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:41:32 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1724 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:41:32.469646 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-62520101-0501-4259-9f2e-243c2f35f3c4 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:32.484684 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-62520101-0501-4259-9f2e-243c2f35f3c4 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f" status: 200 len: 1314 microversion: 2.1 time: 0.277298 Nov 02 14:41:32.505127 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 128/255] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:32 2022] GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:41:33.113639 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-c5fdb0f7-8263-428b-a333-4fa45d2f42cb tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:33.114569 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-c5fdb0f7-8263-428b-a333-4fa45d2f42cb tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 803e6b19-d962-4158-9a6c-e38cbd2b3e04] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:33.118560 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:41:33.127370 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c5fdb0f7-8263-428b-a333-4fa45d2f42cb tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:33.128221 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c5fdb0f7-8263-428b-a333-4fa45d2f42cb tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:33.128869 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c5fdb0f7-8263-428b-a333-4fa45d2f42cb tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:33.129942 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c5fdb0f7-8263-428b-a333-4fa45d2f42cb tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:33.130597 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c5fdb0f7-8263-428b-a333-4fa45d2f42cb tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:33.131281 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c5fdb0f7-8263-428b-a333-4fa45d2f42cb tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:33.291220 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-e64bf9c4-3e38-410e-9cd8-f0b52d69b333 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:33.293192 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-e64bf9c4-3e38-410e-9cd8-f0b52d69b333 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:33.302746 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e64bf9c4-3e38-410e-9cd8-f0b52d69b333 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:33.303488 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e64bf9c4-3e38-410e-9cd8-f0b52d69b333 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:33.304073 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e64bf9c4-3e38-410e-9cd8-f0b52d69b333 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:33.304954 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e64bf9c4-3e38-410e-9cd8-f0b52d69b333 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:33.305576 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e64bf9c4-3e38-410e-9cd8-f0b52d69b333 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:33.306169 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e64bf9c4-3e38-410e-9cd8-f0b52d69b333 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:33.365032 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-c5fdb0f7-8263-428b-a333-4fa45d2f42cb tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:33.373038 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-c5fdb0f7-8263-428b-a333-4fa45d2f42cb tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04" status: 200 len: 1511 microversion: 2.1 time: 0.265141 Nov 02 14:41:33.374133 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 128/256] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:33 2022] GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04 => generated 1511 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:33.482945 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-e64bf9c4-3e38-410e-9cd8-f0b52d69b333 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:33.491418 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-e64bf9c4-3e38-410e-9cd8-f0b52d69b333 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:33.493312 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-e64bf9c4-3e38-410e-9cd8-f0b52d69b333 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:33.494764 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-e64bf9c4-3e38-410e-9cd8-f0b52d69b333 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1724 microversion: 2.20 time: 0.207402 Nov 02 14:41:33.495435 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 129/257] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:41:33 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1724 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:41:33.508258 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-33f340f2-7e27-4eb0-a8b8-59c9ef63a6fe tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:33.509102 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-33f340f2-7e27-4eb0-a8b8-59c9ef63a6fe tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: 400af7ba-398a-4908-8fea-f57eaa4e5a0f] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:33.517648 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-33f340f2-7e27-4eb0-a8b8-59c9ef63a6fe tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:33.517648 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-33f340f2-7e27-4eb0-a8b8-59c9ef63a6fe tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:33.517648 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-33f340f2-7e27-4eb0-a8b8-59c9ef63a6fe tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:33.518184 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-33f340f2-7e27-4eb0-a8b8-59c9ef63a6fe tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:33.518633 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-33f340f2-7e27-4eb0-a8b8-59c9ef63a6fe tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:33.519217 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-33f340f2-7e27-4eb0-a8b8-59c9ef63a6fe tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:34.072883 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-33f340f2-7e27-4eb0-a8b8-59c9ef63a6fe tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:34.086818 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-33f340f2-7e27-4eb0-a8b8-59c9ef63a6fe tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f" status: 200 len: 1314 microversion: 2.1 time: 0.582506 Nov 02 14:41:34.107943 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 129/258] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:33 2022] GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f => generated 1314 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:34.400737 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-96b1ff29-5d3c-4257-82ab-251d73323ee9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:34.401388 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-96b1ff29-5d3c-4257-82ab-251d73323ee9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 803e6b19-d962-4158-9a6c-e38cbd2b3e04] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:34.407892 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-96b1ff29-5d3c-4257-82ab-251d73323ee9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:34.408370 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-96b1ff29-5d3c-4257-82ab-251d73323ee9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:34.408798 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-96b1ff29-5d3c-4257-82ab-251d73323ee9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:34.409502 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-96b1ff29-5d3c-4257-82ab-251d73323ee9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:34.409945 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-96b1ff29-5d3c-4257-82ab-251d73323ee9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:34.410359 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-96b1ff29-5d3c-4257-82ab-251d73323ee9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:34.541701 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-2483e2e8-f5d9-4acf-8deb-9eef7bbb2800 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:34.542330 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-2483e2e8-f5d9-4acf-8deb-9eef7bbb2800 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:34.549729 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2483e2e8-f5d9-4acf-8deb-9eef7bbb2800 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:34.550302 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2483e2e8-f5d9-4acf-8deb-9eef7bbb2800 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:34.550801 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2483e2e8-f5d9-4acf-8deb-9eef7bbb2800 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:34.551628 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2483e2e8-f5d9-4acf-8deb-9eef7bbb2800 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:34.552177 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2483e2e8-f5d9-4acf-8deb-9eef7bbb2800 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:34.552682 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2483e2e8-f5d9-4acf-8deb-9eef7bbb2800 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:34.586242 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-96b1ff29-5d3c-4257-82ab-251d73323ee9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:34.595768 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-96b1ff29-5d3c-4257-82ab-251d73323ee9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04" status: 200 len: 1511 microversion: 2.1 time: 0.198246 Nov 02 14:41:34.601836 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 130/259] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:34 2022] GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04 => generated 1511 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:41:34.705426 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-2483e2e8-f5d9-4acf-8deb-9eef7bbb2800 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:34.714621 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-2483e2e8-f5d9-4acf-8deb-9eef7bbb2800 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:34.716064 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-2483e2e8-f5d9-4acf-8deb-9eef7bbb2800 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:34.717266 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-2483e2e8-f5d9-4acf-8deb-9eef7bbb2800 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1724 microversion: 2.20 time: 0.195746 Nov 02 14:41:34.717821 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 130/260] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:41:34 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:41:35.113830 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-d7597307-4790-4055-abfb-a2dcc8c02783 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:35.117539 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-d7597307-4790-4055-abfb-a2dcc8c02783 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: 400af7ba-398a-4908-8fea-f57eaa4e5a0f] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:35.129242 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d7597307-4790-4055-abfb-a2dcc8c02783 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:35.133792 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d7597307-4790-4055-abfb-a2dcc8c02783 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:35.134239 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d7597307-4790-4055-abfb-a2dcc8c02783 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:35.136205 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d7597307-4790-4055-abfb-a2dcc8c02783 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:35.136664 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d7597307-4790-4055-abfb-a2dcc8c02783 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:35.137117 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d7597307-4790-4055-abfb-a2dcc8c02783 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:35.347818 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-d7597307-4790-4055-abfb-a2dcc8c02783 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:35.360103 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-d7597307-4790-4055-abfb-a2dcc8c02783 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f" status: 200 len: 1314 microversion: 2.1 time: 0.250482 Nov 02 14:41:35.373216 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 131/261] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:35 2022] GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:35.623685 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-5e72b832-6237-4f6f-bab0-7118ebfb5664 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:35.624216 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-5e72b832-6237-4f6f-bab0-7118ebfb5664 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 803e6b19-d962-4158-9a6c-e38cbd2b3e04] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:35.631941 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5e72b832-6237-4f6f-bab0-7118ebfb5664 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:35.632464 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5e72b832-6237-4f6f-bab0-7118ebfb5664 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:35.632903 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5e72b832-6237-4f6f-bab0-7118ebfb5664 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:35.633849 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5e72b832-6237-4f6f-bab0-7118ebfb5664 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:35.634304 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5e72b832-6237-4f6f-bab0-7118ebfb5664 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:35.634927 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5e72b832-6237-4f6f-bab0-7118ebfb5664 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:35.746329 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-68dab50e-4b17-4e62-9c3d-13c8f3550cb2 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:35.747079 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-68dab50e-4b17-4e62-9c3d-13c8f3550cb2 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:35.754374 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-68dab50e-4b17-4e62-9c3d-13c8f3550cb2 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:35.755052 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-68dab50e-4b17-4e62-9c3d-13c8f3550cb2 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:35.758330 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-68dab50e-4b17-4e62-9c3d-13c8f3550cb2 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:35.759222 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-68dab50e-4b17-4e62-9c3d-13c8f3550cb2 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:35.759788 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-68dab50e-4b17-4e62-9c3d-13c8f3550cb2 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:35.760585 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-68dab50e-4b17-4e62-9c3d-13c8f3550cb2 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:35.783894 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:41:35.877060 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-5e72b832-6237-4f6f-bab0-7118ebfb5664 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:35.896880 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-5e72b832-6237-4f6f-bab0-7118ebfb5664 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04" status: 200 len: 1511 microversion: 2.1 time: 0.265763 Nov 02 14:41:35.902053 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 131/262] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:35 2022] GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04 => generated 1511 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:35.971318 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-68dab50e-4b17-4e62-9c3d-13c8f3550cb2 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:35.987539 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-68dab50e-4b17-4e62-9c3d-13c8f3550cb2 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:35.987539 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-68dab50e-4b17-4e62-9c3d-13c8f3550cb2 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:35.987795 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-68dab50e-4b17-4e62-9c3d-13c8f3550cb2 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1724 microversion: 2.20 time: 0.245798 Nov 02 14:41:35.988643 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 132/263] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:41:35 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1724 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:41:36.386022 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-644c0c87-86a7-4da6-8a66-24e38159a091 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:36.386681 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-644c0c87-86a7-4da6-8a66-24e38159a091 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: 400af7ba-398a-4908-8fea-f57eaa4e5a0f] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:36.398079 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-644c0c87-86a7-4da6-8a66-24e38159a091 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:36.398527 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-644c0c87-86a7-4da6-8a66-24e38159a091 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:36.405318 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-644c0c87-86a7-4da6-8a66-24e38159a091 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:36.405318 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-644c0c87-86a7-4da6-8a66-24e38159a091 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:36.405318 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-644c0c87-86a7-4da6-8a66-24e38159a091 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:36.405318 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-644c0c87-86a7-4da6-8a66-24e38159a091 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:36.662890 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-644c0c87-86a7-4da6-8a66-24e38159a091 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:36.675630 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-644c0c87-86a7-4da6-8a66-24e38159a091 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f" status: 200 len: 1314 microversion: 2.1 time: 0.293620 Nov 02 14:41:36.679216 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 132/264] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:36 2022] GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:36.927161 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-a4139849-bc64-43c5-94d4-1357efef6ccd tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:36.927759 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-a4139849-bc64-43c5-94d4-1357efef6ccd tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 803e6b19-d962-4158-9a6c-e38cbd2b3e04] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:36.935498 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_api:SELECT=70 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:41:36.946247 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a4139849-bc64-43c5-94d4-1357efef6ccd tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:36.952287 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a4139849-bc64-43c5-94d4-1357efef6ccd tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:36.953100 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a4139849-bc64-43c5-94d4-1357efef6ccd tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:36.957089 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a4139849-bc64-43c5-94d4-1357efef6ccd tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:36.957673 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a4139849-bc64-43c5-94d4-1357efef6ccd tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:36.958131 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a4139849-bc64-43c5-94d4-1357efef6ccd tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:37.030573 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-b0228887-df2a-4790-b9ad-ca37d37ae132 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:37.030786 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-b0228887-df2a-4790-b9ad-ca37d37ae132 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:37.045156 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b0228887-df2a-4790-b9ad-ca37d37ae132 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:37.045156 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b0228887-df2a-4790-b9ad-ca37d37ae132 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:37.045501 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b0228887-df2a-4790-b9ad-ca37d37ae132 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:37.045951 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b0228887-df2a-4790-b9ad-ca37d37ae132 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:37.046407 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b0228887-df2a-4790-b9ad-ca37d37ae132 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:37.046832 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b0228887-df2a-4790-b9ad-ca37d37ae132 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:37.364284 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-a4139849-bc64-43c5-94d4-1357efef6ccd tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:37.375445 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-a4139849-bc64-43c5-94d4-1357efef6ccd tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04" status: 200 len: 1511 microversion: 2.1 time: 0.452629 Nov 02 14:41:37.375818 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 133/265] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:36 2022] GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04 => generated 1511 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:37.395517 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-b0228887-df2a-4790-b9ad-ca37d37ae132 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:37.404607 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-b0228887-df2a-4790-b9ad-ca37d37ae132 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:37.415553 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-b0228887-df2a-4790-b9ad-ca37d37ae132 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:37.416978 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-b0228887-df2a-4790-b9ad-ca37d37ae132 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1724 microversion: 2.20 time: 0.390886 Nov 02 14:41:37.429502 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 133/266] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:41:37 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1724 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:41:37.703164 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-7b909ce8-ca88-48cb-a2c4-f924d8b4466d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:37.703940 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-7b909ce8-ca88-48cb-a2c4-f924d8b4466d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: 400af7ba-398a-4908-8fea-f57eaa4e5a0f] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:37.710427 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7b909ce8-ca88-48cb-a2c4-f924d8b4466d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:37.711036 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7b909ce8-ca88-48cb-a2c4-f924d8b4466d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:37.711591 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7b909ce8-ca88-48cb-a2c4-f924d8b4466d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:37.712387 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7b909ce8-ca88-48cb-a2c4-f924d8b4466d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:37.712932 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7b909ce8-ca88-48cb-a2c4-f924d8b4466d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:37.713479 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7b909ce8-ca88-48cb-a2c4-f924d8b4466d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:37.870005 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-7b909ce8-ca88-48cb-a2c4-f924d8b4466d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:37.879665 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-7b909ce8-ca88-48cb-a2c4-f924d8b4466d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f" status: 200 len: 1314 microversion: 2.1 time: 0.180205 Nov 02 14:41:37.880268 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 134/267] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:37 2022] GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:38.403528 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-e072098f-d61d-4035-9403-d9871047b013 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:38.404166 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-e072098f-d61d-4035-9403-d9871047b013 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 803e6b19-d962-4158-9a6c-e38cbd2b3e04] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:38.412155 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e072098f-d61d-4035-9403-d9871047b013 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:38.412643 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e072098f-d61d-4035-9403-d9871047b013 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:38.413119 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e072098f-d61d-4035-9403-d9871047b013 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:38.413821 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e072098f-d61d-4035-9403-d9871047b013 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:38.414268 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e072098f-d61d-4035-9403-d9871047b013 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:38.414692 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e072098f-d61d-4035-9403-d9871047b013 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:38.447363 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-46d4c5d6-ce66-411d-abbd-80ba351bd443 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:38.447363 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-46d4c5d6-ce66-411d-abbd-80ba351bd443 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:38.487075 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-46d4c5d6-ce66-411d-abbd-80ba351bd443 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:38.487075 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-46d4c5d6-ce66-411d-abbd-80ba351bd443 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:38.487075 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-46d4c5d6-ce66-411d-abbd-80ba351bd443 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:38.487075 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-46d4c5d6-ce66-411d-abbd-80ba351bd443 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:38.487422 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-46d4c5d6-ce66-411d-abbd-80ba351bd443 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:38.487422 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-46d4c5d6-ce66-411d-abbd-80ba351bd443 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:38.672220 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-e072098f-d61d-4035-9403-d9871047b013 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:38.680225 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-46d4c5d6-ce66-411d-abbd-80ba351bd443 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:38.680432 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-e072098f-d61d-4035-9403-d9871047b013 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04" status: 200 len: 1511 microversion: 2.1 time: 0.281211 Nov 02 14:41:38.681022 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 134/268] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:38 2022] GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04 => generated 1511 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:38.693606 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-46d4c5d6-ce66-411d-abbd-80ba351bd443 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:38.695097 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-46d4c5d6-ce66-411d-abbd-80ba351bd443 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:38.696247 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-46d4c5d6-ce66-411d-abbd-80ba351bd443 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1724 microversion: 2.20 time: 0.256202 Nov 02 14:41:38.696801 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 135/269] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:41:38 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1724 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:41:38.903169 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-f8c1bf93-a5f6-4f02-9c46-aa3d85fafd97 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:38.905815 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-f8c1bf93-a5f6-4f02-9c46-aa3d85fafd97 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: 400af7ba-398a-4908-8fea-f57eaa4e5a0f] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:38.911398 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f8c1bf93-a5f6-4f02-9c46-aa3d85fafd97 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:38.911962 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f8c1bf93-a5f6-4f02-9c46-aa3d85fafd97 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:38.912469 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f8c1bf93-a5f6-4f02-9c46-aa3d85fafd97 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:38.913336 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f8c1bf93-a5f6-4f02-9c46-aa3d85fafd97 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:38.913953 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f8c1bf93-a5f6-4f02-9c46-aa3d85fafd97 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:38.914597 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f8c1bf93-a5f6-4f02-9c46-aa3d85fafd97 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:39.125959 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-f8c1bf93-a5f6-4f02-9c46-aa3d85fafd97 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:39.134983 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-f8c1bf93-a5f6-4f02-9c46-aa3d85fafd97 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f" status: 200 len: 1314 microversion: 2.1 time: 0.235738 Nov 02 14:41:39.149145 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 135/270] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:38 2022] GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:39.704060 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-8defd04f-072e-4bdf-a22f-52e180e94917 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:39.705385 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-8defd04f-072e-4bdf-a22f-52e180e94917 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 803e6b19-d962-4158-9a6c-e38cbd2b3e04] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:39.711339 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8defd04f-072e-4bdf-a22f-52e180e94917 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:39.712562 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8defd04f-072e-4bdf-a22f-52e180e94917 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:39.712562 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8defd04f-072e-4bdf-a22f-52e180e94917 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:39.712965 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8defd04f-072e-4bdf-a22f-52e180e94917 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:39.713445 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8defd04f-072e-4bdf-a22f-52e180e94917 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:39.713868 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8defd04f-072e-4bdf-a22f-52e180e94917 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:39.722198 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-64483a39-739f-43d4-9ae6-5272b4eaf4e4 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:39.722797 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-64483a39-739f-43d4-9ae6-5272b4eaf4e4 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:39.729274 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-64483a39-739f-43d4-9ae6-5272b4eaf4e4 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:39.729752 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-64483a39-739f-43d4-9ae6-5272b4eaf4e4 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:39.730180 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-64483a39-739f-43d4-9ae6-5272b4eaf4e4 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:39.731125 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-64483a39-739f-43d4-9ae6-5272b4eaf4e4 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:39.731568 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-64483a39-739f-43d4-9ae6-5272b4eaf4e4 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:39.731982 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-64483a39-739f-43d4-9ae6-5272b4eaf4e4 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:39.911289 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-8defd04f-072e-4bdf-a22f-52e180e94917 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:39.919916 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-8defd04f-072e-4bdf-a22f-52e180e94917 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04" status: 200 len: 1511 microversion: 2.1 time: 0.219898 Nov 02 14:41:39.920605 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 136/271] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:39 2022] GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04 => generated 1511 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:39.925967 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-bc0db196-75e2-4221-9781-1b30848ba18f tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Action: 'create', calling method: .version_select at 0x7fb24f2aedc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-755497176", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPcKC26Y1xXYzDs9rsnP8gBQjtXCwPYF1s00HPP1T08auTEm9nNMnRG85zckjo8k+t8aWuY/Z+1Y4BMLPNEcyf/gkVAnlHLdQK21szTeIP1FKOZv1GiQJcEFJpiyv4S8eg=="}} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:41:39.946152 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-64483a39-739f-43d4-9ae6-5272b4eaf4e4 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:39.949607 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.quota [None req-bc0db196-75e2-4221-9781-1b30848ba18f tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Getting quotas for project e60a52ce75b94198ac6abb7727e7072d. Resources: {'key_pairs'} {{(pid=119658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:41:39.950976 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.quota [None req-bc0db196-75e2-4221-9781-1b30848ba18f tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Getting quotas for user 277cc06a6df04ca4ab453de57ee84279 and project e60a52ce75b94198ac6abb7727e7072d. Resources: {'key_pairs'} {{(pid=119658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:41:39.957798 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-64483a39-739f-43d4-9ae6-5272b4eaf4e4 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:39.960228 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-64483a39-739f-43d4-9ae6-5272b4eaf4e4 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:39.961287 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-64483a39-739f-43d4-9ae6-5272b4eaf4e4 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1724 microversion: 2.20 time: 0.243009 Nov 02 14:41:39.961967 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 136/272] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:41:39 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1724 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:41:40.120350 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-bc0db196-75e2-4221-9781-1b30848ba18f tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.198844 Nov 02 14:41:40.121209 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 137/273] 10.222.0.30 () {60 vars in 1159 bytes} [Wed Nov 2 14:41:39 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:41:40.159280 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-6a17d607-83d5-46a9-81a9-ff88d39f6d33 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:40.159941 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-6a17d607-83d5-46a9-81a9-ff88d39f6d33 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: 400af7ba-398a-4908-8fea-f57eaa4e5a0f] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:40.165846 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6a17d607-83d5-46a9-81a9-ff88d39f6d33 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:40.166318 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6a17d607-83d5-46a9-81a9-ff88d39f6d33 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:40.166746 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6a17d607-83d5-46a9-81a9-ff88d39f6d33 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:40.167437 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6a17d607-83d5-46a9-81a9-ff88d39f6d33 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:40.167895 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6a17d607-83d5-46a9-81a9-ff88d39f6d33 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:40.168670 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6a17d607-83d5-46a9-81a9-ff88d39f6d33 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:40.233197 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-b469b4f1-fc7c-45e1-a847-fd2c059654d5 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2090694619", "imageRef": "3670cc8b-f79b-4104-bf63-b185c212c247", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-755497176", "networks": [{"uuid": "a5e8c38f-06c6-404d-bcd7-7c9cd1de864c"}]}} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:41:40.302098 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.network.neutron [None req-b469b4f1-fc7c-45e1-a847-fd2c059654d5 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] validate_networks() for [('a5e8c38f-06c6-404d-bcd7-7c9cd1de864c', None, None, None, None, None)] {{(pid=119658) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:41:40.320758 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-6a17d607-83d5-46a9-81a9-ff88d39f6d33 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:40.334758 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-6a17d607-83d5-46a9-81a9-ff88d39f6d33 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f" status: 200 len: 1314 microversion: 2.1 time: 0.176222 Nov 02 14:41:40.334758 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 137/274] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:40 2022] GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:40.698841 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-b469b4f1-fc7c-45e1-a847-fd2c059654d5 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Flavor limits 0:0:0 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:41:40.699260 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-b469b4f1-fc7c-45e1-a847-fd2c059654d5 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Image limits 0:0:0 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:41:40.699721 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-b469b4f1-fc7c-45e1-a847-fd2c059654d5 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Flavor pref 0:0:0 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:41:40.700118 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-b469b4f1-fc7c-45e1-a847-fd2c059654d5 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Image pref 0:0:0 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:41:40.700580 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-b469b4f1-fc7c-45e1-a847-fd2c059654d5 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:41:40.714679 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b469b4f1-fc7c-45e1-a847-fd2c059654d5 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:40.715343 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b469b4f1-fc7c-45e1-a847-fd2c059654d5 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:40.715575 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b469b4f1-fc7c-45e1-a847-fd2c059654d5 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:40.716296 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b469b4f1-fc7c-45e1-a847-fd2c059654d5 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:40.716741 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b469b4f1-fc7c-45e1-a847-fd2c059654d5 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:40.717258 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b469b4f1-fc7c-45e1-a847-fd2c059654d5 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:40.735453 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.quota [None req-b469b4f1-fc7c-45e1-a847-fd2c059654d5 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Getting quotas for project e60a52ce75b94198ac6abb7727e7072d. Resources: {'instances', 'ram', 'cores'} {{(pid=119658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:41:40.740051 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.quota [None req-b469b4f1-fc7c-45e1-a847-fd2c059654d5 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Getting quotas for user 277cc06a6df04ca4ab453de57ee84279 and project e60a52ce75b94198ac6abb7727e7072d. Resources: {'instances', 'ram', 'cores'} {{(pid=119658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:41:40.751913 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-b469b4f1-fc7c-45e1-a847-fd2c059654d5 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Going to run 1 instances... {{(pid=119658) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:41:40.755077 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-b469b4f1-fc7c-45e1-a847-fd2c059654d5 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3670cc8b-f79b-4104-bf63-b185c212c247',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119658) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:41:40.944168 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-622b31f1-5459-4b7d-90ca-9ce989305759 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:40.945095 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-622b31f1-5459-4b7d-90ca-9ce989305759 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 803e6b19-d962-4158-9a6c-e38cbd2b3e04] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:40.951426 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-622b31f1-5459-4b7d-90ca-9ce989305759 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:40.951900 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-622b31f1-5459-4b7d-90ca-9ce989305759 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:40.952498 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-622b31f1-5459-4b7d-90ca-9ce989305759 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:40.953447 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-622b31f1-5459-4b7d-90ca-9ce989305759 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:40.953672 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-622b31f1-5459-4b7d-90ca-9ce989305759 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:40.954090 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-622b31f1-5459-4b7d-90ca-9ce989305759 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:41.021189 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-b469b4f1-fc7c-45e1-a847-fd2c059654d5 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.790675 Nov 02 14:41:41.021189 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 138/275] 10.222.0.30 () {60 vars in 1147 bytes} [Wed Nov 2 14:41:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:41:41.025287 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-d23c290b-4bfd-450d-8845-a0e0b13bdc73 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:41.027322 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-d23c290b-4bfd-450d-8845-a0e0b13bdc73 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:41.037391 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d23c290b-4bfd-450d-8845-a0e0b13bdc73 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:41.037874 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d23c290b-4bfd-450d-8845-a0e0b13bdc73 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:41.038901 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d23c290b-4bfd-450d-8845-a0e0b13bdc73 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:41.039026 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d23c290b-4bfd-450d-8845-a0e0b13bdc73 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:41.039421 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d23c290b-4bfd-450d-8845-a0e0b13bdc73 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:41.039838 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d23c290b-4bfd-450d-8845-a0e0b13bdc73 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:41.156490 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-622b31f1-5459-4b7d-90ca-9ce989305759 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:41.165041 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-622b31f1-5459-4b7d-90ca-9ce989305759 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04" status: 200 len: 1517 microversion: 2.1 time: 0.224746 Nov 02 14:41:41.165605 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 138/276] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:40 2022] GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04 => generated 1517 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:41:41.170606 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-683441aa-60aa-47b0-a19c-0f71fbf93b3d tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:41.171208 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-683441aa-60aa-47b0-a19c-0f71fbf93b3d tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:41.253486 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-683441aa-60aa-47b0-a19c-0f71fbf93b3d tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cc06a6df04ca4ab453de57ee84279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60a52ce75b94198ac6abb7727e7072d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:41.257664 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-d23c290b-4bfd-450d-8845-a0e0b13bdc73 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:41.268215 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-683441aa-60aa-47b0-a19c-0f71fbf93b3d tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7" status: 200 len: 1258 microversion: 2.1 time: 0.101387 Nov 02 14:41:41.286823 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-d23c290b-4bfd-450d-8845-a0e0b13bdc73 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:41.288628 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-d23c290b-4bfd-450d-8845-a0e0b13bdc73 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:41.288966 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 139/277] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:41 2022] GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7 => generated 1258 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:41.297435 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-d23c290b-4bfd-450d-8845-a0e0b13bdc73 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1724 microversion: 2.20 time: 0.269170 Nov 02 14:41:41.297435 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 139/278] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:41:41 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1724 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:41:41.356845 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-c2e7383c-eb47-447f-b17d-a1ff4915874d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:41.357492 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-c2e7383c-eb47-447f-b17d-a1ff4915874d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: 400af7ba-398a-4908-8fea-f57eaa4e5a0f] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:41.364321 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c2e7383c-eb47-447f-b17d-a1ff4915874d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:41.365109 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c2e7383c-eb47-447f-b17d-a1ff4915874d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:41.365545 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c2e7383c-eb47-447f-b17d-a1ff4915874d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:41.366404 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c2e7383c-eb47-447f-b17d-a1ff4915874d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:41.366860 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c2e7383c-eb47-447f-b17d-a1ff4915874d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:41.367285 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c2e7383c-eb47-447f-b17d-a1ff4915874d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:41.524392 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-c2e7383c-eb47-447f-b17d-a1ff4915874d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:41.532182 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-c2e7383c-eb47-447f-b17d-a1ff4915874d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f" status: 200 len: 1498 microversion: 2.1 time: 0.180179 Nov 02 14:41:41.532788 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 140/279] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:41 2022] GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f => generated 1498 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:42.293234 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-c9f86a78-a946-486f-bc7c-4575d1aafa25 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:42.293857 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-c9f86a78-a946-486f-bc7c-4575d1aafa25 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:42.326072 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-f8254090-996a-4bbe-b03e-1b911a2057c6 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:42.326792 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-f8254090-996a-4bbe-b03e-1b911a2057c6 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:42.346499 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f8254090-996a-4bbe-b03e-1b911a2057c6 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:42.347094 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f8254090-996a-4bbe-b03e-1b911a2057c6 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:42.347814 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f8254090-996a-4bbe-b03e-1b911a2057c6 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:42.348928 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f8254090-996a-4bbe-b03e-1b911a2057c6 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:42.350171 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f8254090-996a-4bbe-b03e-1b911a2057c6 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:42.350913 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f8254090-996a-4bbe-b03e-1b911a2057c6 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:42.351295 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-c9f86a78-a946-486f-bc7c-4575d1aafa25 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cc06a6df04ca4ab453de57ee84279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60a52ce75b94198ac6abb7727e7072d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:42.360010 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-c9f86a78-a946-486f-bc7c-4575d1aafa25 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7" status: 200 len: 1258 microversion: 2.1 time: 0.070578 Nov 02 14:41:42.360729 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 140/280] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:42 2022] GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7 => generated 1258 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:42.502839 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-f8254090-996a-4bbe-b03e-1b911a2057c6 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:42.511384 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-f8254090-996a-4bbe-b03e-1b911a2057c6 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:42.512852 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-f8254090-996a-4bbe-b03e-1b911a2057c6 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:42.514061 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-f8254090-996a-4bbe-b03e-1b911a2057c6 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1724 microversion: 2.20 time: 0.192118 Nov 02 14:41:42.514627 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 141/281] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:41:42 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1724 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:41:43.070820 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-92130d3c-8acc-43fc-9e9a-dfda75435700 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Action: 'create', calling method: .version_select at 0x7fb24f1160d0>, body: {"keypair": {"name": "tempest-keypair-872299571", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFAK4yxKifoPbYVTMgINAq+yXJA9vxpvxNVGPDjR9UfCHhe5ic0PYmLKJ63YqVcbXgUUErQQlXdlBjMB1XuyQW1EQ/lovuPviJP8v8p3mfjOnyYIa/9jW9qR9+YlxwCwEQ=="}} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:41:43.087311 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.quota [None req-92130d3c-8acc-43fc-9e9a-dfda75435700 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Getting quotas for project edc675d4a92f4ff9ae8a41a020fa792c. Resources: {'key_pairs'} {{(pid=119658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:41:43.091228 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.quota [None req-92130d3c-8acc-43fc-9e9a-dfda75435700 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Getting quotas for user 921ba33e2e0740278b7b6fb4af248363 and project edc675d4a92f4ff9ae8a41a020fa792c. Resources: {'key_pairs'} {{(pid=119658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:41:43.182361 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-43dd9588-d2a2-4eea-9d90-df7e8eb3f0e6 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:43.182861 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-43dd9588-d2a2-4eea-9d90-df7e8eb3f0e6 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: 400af7ba-398a-4908-8fea-f57eaa4e5a0f] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:43.188805 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-92130d3c-8acc-43fc-9e9a-dfda75435700 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.121674 Nov 02 14:41:43.192818 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 141/282] 10.222.0.30 () {60 vars in 1159 bytes} [Wed Nov 2 14:41:43 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:41:43.193763 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-43dd9588-d2a2-4eea-9d90-df7e8eb3f0e6 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:43.194318 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-43dd9588-d2a2-4eea-9d90-df7e8eb3f0e6 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:43.194747 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-43dd9588-d2a2-4eea-9d90-df7e8eb3f0e6 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:43.195663 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-43dd9588-d2a2-4eea-9d90-df7e8eb3f0e6 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:43.196114 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-43dd9588-d2a2-4eea-9d90-df7e8eb3f0e6 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:43.196546 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-43dd9588-d2a2-4eea-9d90-df7e8eb3f0e6 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:43.213181 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:41:43.224400 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-43dd9588-d2a2-4eea-9d90-df7e8eb3f0e6 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: 400af7ba-398a-4908-8fea-f57eaa4e5a0f] Going to try to terminate instance {{(pid=119659) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:41:43.386526 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-9cf1f2bb-0633-4959-b5d9-c6a1e73833e0 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:43.387201 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-9cf1f2bb-0633-4959-b5d9-c6a1e73833e0 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:43.396079 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9cf1f2bb-0633-4959-b5d9-c6a1e73833e0 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:43.396572 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9cf1f2bb-0633-4959-b5d9-c6a1e73833e0 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:43.397189 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9cf1f2bb-0633-4959-b5d9-c6a1e73833e0 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:43.398088 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9cf1f2bb-0633-4959-b5d9-c6a1e73833e0 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:43.398742 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9cf1f2bb-0633-4959-b5d9-c6a1e73833e0 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:43.399226 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9cf1f2bb-0633-4959-b5d9-c6a1e73833e0 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:43.492281 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-9cf1f2bb-0633-4959-b5d9-c6a1e73833e0 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cc06a6df04ca4ab453de57ee84279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60a52ce75b94198ac6abb7727e7072d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:43.518160 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-9cf1f2bb-0633-4959-b5d9-c6a1e73833e0 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7" status: 200 len: 1310 microversion: 2.1 time: 0.138205 Nov 02 14:41:43.519202 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 142/283] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:43 2022] GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7 => generated 1310 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:41:43.543244 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-228e31f2-2b15-4bbf-a413-7e42f6522762 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:43.544860 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-228e31f2-2b15-4bbf-a413-7e42f6522762 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:43.554437 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-228e31f2-2b15-4bbf-a413-7e42f6522762 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:43.554984 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-228e31f2-2b15-4bbf-a413-7e42f6522762 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:43.555902 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-228e31f2-2b15-4bbf-a413-7e42f6522762 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:43.556694 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-228e31f2-2b15-4bbf-a413-7e42f6522762 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:43.557379 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-228e31f2-2b15-4bbf-a413-7e42f6522762 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:43.557850 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-228e31f2-2b15-4bbf-a413-7e42f6522762 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:43.695475 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-43dd9588-d2a2-4eea-9d90-df7e8eb3f0e6 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "DELETE /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f" status: 204 len: 0 microversion: 2.1 time: 0.516892 Nov 02 14:41:43.696624 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 142/284] 10.222.0.30 () {58 vars in 1239 bytes} [Wed Nov 2 14:41:43 2022] DELETE /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f => generated 0 bytes in 519 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:41:43.697758 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-228e31f2-2b15-4bbf-a413-7e42f6522762 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:43.707165 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-0999fbce-a716-45f1-8cda-80db8f9e5662 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:43.707874 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-0999fbce-a716-45f1-8cda-80db8f9e5662 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: 400af7ba-398a-4908-8fea-f57eaa4e5a0f] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:43.708158 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-228e31f2-2b15-4bbf-a413-7e42f6522762 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:43.709654 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-228e31f2-2b15-4bbf-a413-7e42f6522762 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:43.711063 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-228e31f2-2b15-4bbf-a413-7e42f6522762 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1724 microversion: 2.20 time: 0.174262 Nov 02 14:41:43.714502 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0999fbce-a716-45f1-8cda-80db8f9e5662 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:43.714996 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0999fbce-a716-45f1-8cda-80db8f9e5662 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:43.715434 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0999fbce-a716-45f1-8cda-80db8f9e5662 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:43.716157 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0999fbce-a716-45f1-8cda-80db8f9e5662 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:43.716613 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0999fbce-a716-45f1-8cda-80db8f9e5662 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:43.717063 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0999fbce-a716-45f1-8cda-80db8f9e5662 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:43.721682 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 143/285] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:41:43 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:41:43.909288 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-0999fbce-a716-45f1-8cda-80db8f9e5662 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:43.918979 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-0999fbce-a716-45f1-8cda-80db8f9e5662 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f" status: 200 len: 1504 microversion: 2.1 time: 0.216733 Nov 02 14:41:43.919936 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 143/286] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:43 2022] GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f => generated 1504 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:44.543518 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-72e9034f-3314-488e-96da-e9e07f205ebe tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:44.544142 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-72e9034f-3314-488e-96da-e9e07f205ebe tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:44.550436 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-72e9034f-3314-488e-96da-e9e07f205ebe tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:44.550912 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-72e9034f-3314-488e-96da-e9e07f205ebe tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:44.551349 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-72e9034f-3314-488e-96da-e9e07f205ebe tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:44.552032 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-72e9034f-3314-488e-96da-e9e07f205ebe tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:44.552480 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-72e9034f-3314-488e-96da-e9e07f205ebe tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:44.552903 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-72e9034f-3314-488e-96da-e9e07f205ebe tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:44.671348 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-72e9034f-3314-488e-96da-e9e07f205ebe tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cc06a6df04ca4ab453de57ee84279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60a52ce75b94198ac6abb7727e7072d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:44.679267 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-72e9034f-3314-488e-96da-e9e07f205ebe tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7" status: 200 len: 1310 microversion: 2.1 time: 0.139603 Nov 02 14:41:44.679851 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 144/287] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:44 2022] GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7 => generated 1310 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:44.739186 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-b36e5daa-4ea2-45a9-b554-38f2dc04954d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:44.739792 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-b36e5daa-4ea2-45a9-b554-38f2dc04954d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:44.747071 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b36e5daa-4ea2-45a9-b554-38f2dc04954d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:44.747550 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b36e5daa-4ea2-45a9-b554-38f2dc04954d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:44.748030 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b36e5daa-4ea2-45a9-b554-38f2dc04954d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:44.748875 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b36e5daa-4ea2-45a9-b554-38f2dc04954d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:44.749352 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b36e5daa-4ea2-45a9-b554-38f2dc04954d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:44.749825 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b36e5daa-4ea2-45a9-b554-38f2dc04954d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:44.951930 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-09242f02-6441-4138-8ec6-1fa79675c5e2 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:44.952538 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-09242f02-6441-4138-8ec6-1fa79675c5e2 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: 400af7ba-398a-4908-8fea-f57eaa4e5a0f] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:44.959494 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-09242f02-6441-4138-8ec6-1fa79675c5e2 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:44.959986 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-09242f02-6441-4138-8ec6-1fa79675c5e2 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:44.960421 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-09242f02-6441-4138-8ec6-1fa79675c5e2 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:44.961192 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-09242f02-6441-4138-8ec6-1fa79675c5e2 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:44.961715 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-09242f02-6441-4138-8ec6-1fa79675c5e2 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:44.962139 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-09242f02-6441-4138-8ec6-1fa79675c5e2 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:44.995961 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-b36e5daa-4ea2-45a9-b554-38f2dc04954d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:45.006366 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-b36e5daa-4ea2-45a9-b554-38f2dc04954d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:45.007937 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-b36e5daa-4ea2-45a9-b554-38f2dc04954d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:45.022429 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-b36e5daa-4ea2-45a9-b554-38f2dc04954d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1724 microversion: 2.20 time: 0.274578 Nov 02 14:41:45.022429 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 144/288] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:41:44 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1724 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:41:45.197649 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-09242f02-6441-4138-8ec6-1fa79675c5e2 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:45.206504 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-09242f02-6441-4138-8ec6-1fa79675c5e2 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f" status: 200 len: 1504 microversion: 2.1 time: 0.258460 Nov 02 14:41:45.207098 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 145/289] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:44 2022] GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f => generated 1504 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:41:45.702039 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-a854940c-67d1-4319-924a-6937d2f75d23 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:45.702739 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-a854940c-67d1-4319-924a-6937d2f75d23 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:45.708801 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a854940c-67d1-4319-924a-6937d2f75d23 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:45.710556 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a854940c-67d1-4319-924a-6937d2f75d23 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:45.711235 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a854940c-67d1-4319-924a-6937d2f75d23 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:45.711957 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a854940c-67d1-4319-924a-6937d2f75d23 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:45.712412 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a854940c-67d1-4319-924a-6937d2f75d23 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:45.712835 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a854940c-67d1-4319-924a-6937d2f75d23 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:45.793744 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-a854940c-67d1-4319-924a-6937d2f75d23 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cc06a6df04ca4ab453de57ee84279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60a52ce75b94198ac6abb7727e7072d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:45.804281 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-a854940c-67d1-4319-924a-6937d2f75d23 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7" status: 200 len: 1310 microversion: 2.1 time: 0.105333 Nov 02 14:41:45.807047 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 145/290] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:45 2022] GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7 => generated 1310 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:46.041145 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-bd42b82e-1b43-421b-a760-3aa8dda33cca tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:46.042132 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-bd42b82e-1b43-421b-a760-3aa8dda33cca tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:46.051335 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-bd42b82e-1b43-421b-a760-3aa8dda33cca tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:46.052408 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-bd42b82e-1b43-421b-a760-3aa8dda33cca tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:46.052880 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-bd42b82e-1b43-421b-a760-3aa8dda33cca tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:46.053954 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-bd42b82e-1b43-421b-a760-3aa8dda33cca tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:46.054468 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-bd42b82e-1b43-421b-a760-3aa8dda33cca tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:46.054895 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-bd42b82e-1b43-421b-a760-3aa8dda33cca tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:46.230203 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-e0fa6ebd-05f8-428b-92fe-55864ac81285 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:46.231081 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-e0fa6ebd-05f8-428b-92fe-55864ac81285 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: 400af7ba-398a-4908-8fea-f57eaa4e5a0f] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:46.242886 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e0fa6ebd-05f8-428b-92fe-55864ac81285 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:46.243376 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e0fa6ebd-05f8-428b-92fe-55864ac81285 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:46.243806 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e0fa6ebd-05f8-428b-92fe-55864ac81285 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:46.244519 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e0fa6ebd-05f8-428b-92fe-55864ac81285 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:46.245141 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e0fa6ebd-05f8-428b-92fe-55864ac81285 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:46.251820 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e0fa6ebd-05f8-428b-92fe-55864ac81285 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:46.283331 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-bd42b82e-1b43-421b-a760-3aa8dda33cca tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:46.295348 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-bd42b82e-1b43-421b-a760-3aa8dda33cca tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:46.297051 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-bd42b82e-1b43-421b-a760-3aa8dda33cca tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:46.299345 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-bd42b82e-1b43-421b-a760-3aa8dda33cca tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1724 microversion: 2.20 time: 0.261946 Nov 02 14:41:46.299920 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 146/291] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:41:46 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1724 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:41:46.417833 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-e0fa6ebd-05f8-428b-92fe-55864ac81285 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:46.429199 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-e0fa6ebd-05f8-428b-92fe-55864ac81285 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f" status: 200 len: 1504 microversion: 2.1 time: 0.202906 Nov 02 14:41:46.445379 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 146/292] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:46 2022] GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f => generated 1504 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:46.531406 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-e644f3ee-68a5-43d9-ad62-a52ccabceb63 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1086266366", "imageRef": "a726a246-cc7f-46e6-aeff-4d62e03cc091", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bea7d5f3-3f34-426a-97bc-a8938ef4d97b"}], "security_groups": [{"name": "tempest-securitygroup--1884718709"}], "key_name": "tempest-keypair-872299571", "user_data": "}} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:41:46.648668 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.network.neutron [None req-e644f3ee-68a5-43d9-ad62-a52ccabceb63 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] validate_networks() for [('bea7d5f3-3f34-426a-97bc-a8938ef4d97b', None, None, None, None, None)] {{(pid=119658) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:41:46.830943 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-0e787cb0-e45b-4678-9e62-ffbf4a035abc tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:46.833489 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-0e787cb0-e45b-4678-9e62-ffbf4a035abc tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:46.843635 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0e787cb0-e45b-4678-9e62-ffbf4a035abc tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:46.846029 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0e787cb0-e45b-4678-9e62-ffbf4a035abc tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:46.846961 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0e787cb0-e45b-4678-9e62-ffbf4a035abc tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:46.847911 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0e787cb0-e45b-4678-9e62-ffbf4a035abc tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:46.848606 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0e787cb0-e45b-4678-9e62-ffbf4a035abc tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:46.849408 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0e787cb0-e45b-4678-9e62-ffbf4a035abc tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:46.943025 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-0e787cb0-e45b-4678-9e62-ffbf4a035abc tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cc06a6df04ca4ab453de57ee84279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60a52ce75b94198ac6abb7727e7072d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:46.955242 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-0e787cb0-e45b-4678-9e62-ffbf4a035abc tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7" status: 200 len: 1310 microversion: 2.1 time: 0.130958 Nov 02 14:41:46.956260 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 147/293] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:46 2022] GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7 => generated 1310 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:41:47.165024 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-e644f3ee-68a5-43d9-ad62-a52ccabceb63 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Flavor limits 0:0:0 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:41:47.165542 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-e644f3ee-68a5-43d9-ad62-a52ccabceb63 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Image limits 0:0:0 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:41:47.165929 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-e644f3ee-68a5-43d9-ad62-a52ccabceb63 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Flavor pref 0:0:0 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:41:47.166319 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-e644f3ee-68a5-43d9-ad62-a52ccabceb63 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Image pref 0:0:0 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:41:47.166749 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-e644f3ee-68a5-43d9-ad62-a52ccabceb63 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:41:47.176682 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e644f3ee-68a5-43d9-ad62-a52ccabceb63 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:47.177148 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e644f3ee-68a5-43d9-ad62-a52ccabceb63 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:47.177587 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e644f3ee-68a5-43d9-ad62-a52ccabceb63 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:47.178312 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e644f3ee-68a5-43d9-ad62-a52ccabceb63 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:47.178762 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e644f3ee-68a5-43d9-ad62-a52ccabceb63 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:47.179399 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e644f3ee-68a5-43d9-ad62-a52ccabceb63 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:47.198717 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.quota [None req-e644f3ee-68a5-43d9-ad62-a52ccabceb63 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Getting quotas for project edc675d4a92f4ff9ae8a41a020fa792c. Resources: {'instances', 'ram', 'cores'} {{(pid=119658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:41:47.207455 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.quota [None req-e644f3ee-68a5-43d9-ad62-a52ccabceb63 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Getting quotas for user 921ba33e2e0740278b7b6fb4af248363 and project edc675d4a92f4ff9ae8a41a020fa792c. Resources: {'instances', 'ram', 'cores'} {{(pid=119658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:41:47.219132 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-e644f3ee-68a5-43d9-ad62-a52ccabceb63 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Going to run 1 instances... {{(pid=119658) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:41:47.221404 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-e644f3ee-68a5-43d9-ad62-a52ccabceb63 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a726a246-cc7f-46e6-aeff-4d62e03cc091',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119658) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:41:47.328390 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-63874bc5-8b82-4e8c-aa8c-3820335996b8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:47.329079 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-63874bc5-8b82-4e8c-aa8c-3820335996b8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:47.339868 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-63874bc5-8b82-4e8c-aa8c-3820335996b8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:47.339868 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-63874bc5-8b82-4e8c-aa8c-3820335996b8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:47.339868 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-63874bc5-8b82-4e8c-aa8c-3820335996b8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:47.339868 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-63874bc5-8b82-4e8c-aa8c-3820335996b8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:47.340147 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-63874bc5-8b82-4e8c-aa8c-3820335996b8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:47.340147 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-63874bc5-8b82-4e8c-aa8c-3820335996b8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:47.411091 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-e644f3ee-68a5-43d9-ad62-a52ccabceb63 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.884472 Nov 02 14:41:47.418091 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 147/294] 10.222.0.30 () {60 vars in 1147 bytes} [Wed Nov 2 14:41:46 2022] POST /compute/v2.1/servers => generated 409 bytes in 892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:41:47.423558 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-45d10e98-e19a-47bf-bdd1-6af1929149c2 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:47.424953 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-45d10e98-e19a-47bf-bdd1-6af1929149c2 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:47.535803 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-45d10e98-e19a-47bf-bdd1-6af1929149c2 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:47.549120 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-45d10e98-e19a-47bf-bdd1-6af1929149c2 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91" status: 200 len: 1245 microversion: 2.1 time: 0.128984 Nov 02 14:41:47.549715 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 148/295] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:47 2022] GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 => generated 1245 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:47.554680 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-782a6cc2-7c2f-4b18-96cc-6894a5ce4b7d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:47.555498 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-782a6cc2-7c2f-4b18-96cc-6894a5ce4b7d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: 400af7ba-398a-4908-8fea-f57eaa4e5a0f] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:47.562485 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-782a6cc2-7c2f-4b18-96cc-6894a5ce4b7d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:47.562977 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-782a6cc2-7c2f-4b18-96cc-6894a5ce4b7d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:47.563458 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-782a6cc2-7c2f-4b18-96cc-6894a5ce4b7d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:47.564463 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-782a6cc2-7c2f-4b18-96cc-6894a5ce4b7d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:47.565208 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-782a6cc2-7c2f-4b18-96cc-6894a5ce4b7d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:47.565457 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-782a6cc2-7c2f-4b18-96cc-6894a5ce4b7d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:47.609323 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-63874bc5-8b82-4e8c-aa8c-3820335996b8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:47.630174 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-63874bc5-8b82-4e8c-aa8c-3820335996b8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:47.632067 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-63874bc5-8b82-4e8c-aa8c-3820335996b8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:47.633942 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-63874bc5-8b82-4e8c-aa8c-3820335996b8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1724 microversion: 2.20 time: 0.309474 Nov 02 14:41:47.634854 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 148/296] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:41:47 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1724 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:41:47.741957 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-782a6cc2-7c2f-4b18-96cc-6894a5ce4b7d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:47.752168 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-782a6cc2-7c2f-4b18-96cc-6894a5ce4b7d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f" status: 200 len: 1504 microversion: 2.1 time: 0.201212 Nov 02 14:41:47.752973 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 149/297] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:47 2022] GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f => generated 1504 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:47.987317 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-0271a452-573b-4303-9fa3-8c2a763c34e9 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:47.988562 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-0271a452-573b-4303-9fa3-8c2a763c34e9 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:47.995638 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0271a452-573b-4303-9fa3-8c2a763c34e9 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:47.996463 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0271a452-573b-4303-9fa3-8c2a763c34e9 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:47.997219 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0271a452-573b-4303-9fa3-8c2a763c34e9 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:47.998045 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0271a452-573b-4303-9fa3-8c2a763c34e9 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:47.998705 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0271a452-573b-4303-9fa3-8c2a763c34e9 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:47.999333 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0271a452-573b-4303-9fa3-8c2a763c34e9 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:48.070201 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-0271a452-573b-4303-9fa3-8c2a763c34e9 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cc06a6df04ca4ab453de57ee84279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60a52ce75b94198ac6abb7727e7072d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:48.078418 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-0271a452-573b-4303-9fa3-8c2a763c34e9 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7" status: 200 len: 1310 microversion: 2.1 time: 0.096513 Nov 02 14:41:48.079320 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 149/298] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:47 2022] GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7 => generated 1310 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:48.575053 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-9cb73fd5-af93-40c1-9218-9c79d00382f4 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:48.576100 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-9cb73fd5-af93-40c1-9218-9c79d00382f4 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:48.584418 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9cb73fd5-af93-40c1-9218-9c79d00382f4 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:48.584934 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9cb73fd5-af93-40c1-9218-9c79d00382f4 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:48.590308 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9cb73fd5-af93-40c1-9218-9c79d00382f4 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:48.590308 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9cb73fd5-af93-40c1-9218-9c79d00382f4 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:48.590308 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9cb73fd5-af93-40c1-9218-9c79d00382f4 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:48.590308 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9cb73fd5-af93-40c1-9218-9c79d00382f4 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:48.662174 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-0ebf8956-57bd-48fe-8f1d-589b2664d86b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:48.664635 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-0ebf8956-57bd-48fe-8f1d-589b2664d86b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:48.667721 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-9cb73fd5-af93-40c1-9218-9c79d00382f4 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:48.676896 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-9cb73fd5-af93-40c1-9218-9c79d00382f4 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91" status: 200 len: 1249 microversion: 2.1 time: 0.107813 Nov 02 14:41:48.677636 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0ebf8956-57bd-48fe-8f1d-589b2664d86b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:48.677792 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 150/299] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:48 2022] GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 => generated 1249 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:48.678385 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0ebf8956-57bd-48fe-8f1d-589b2664d86b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:48.679016 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0ebf8956-57bd-48fe-8f1d-589b2664d86b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:48.679872 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0ebf8956-57bd-48fe-8f1d-589b2664d86b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:48.680432 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0ebf8956-57bd-48fe-8f1d-589b2664d86b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:48.680947 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0ebf8956-57bd-48fe-8f1d-589b2664d86b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:48.779147 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-1383f3fa-13e9-45c7-b91c-e166ee586e85 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:48.780278 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-1383f3fa-13e9-45c7-b91c-e166ee586e85 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: 400af7ba-398a-4908-8fea-f57eaa4e5a0f] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:48.789519 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1383f3fa-13e9-45c7-b91c-e166ee586e85 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:48.790441 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1383f3fa-13e9-45c7-b91c-e166ee586e85 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:48.791335 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1383f3fa-13e9-45c7-b91c-e166ee586e85 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:48.792601 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1383f3fa-13e9-45c7-b91c-e166ee586e85 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:48.793721 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1383f3fa-13e9-45c7-b91c-e166ee586e85 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:48.794747 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1383f3fa-13e9-45c7-b91c-e166ee586e85 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:49.142777 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-0ebf8956-57bd-48fe-8f1d-589b2664d86b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:49.153613 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-0ebf8956-57bd-48fe-8f1d-589b2664d86b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:49.155859 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-0ebf8956-57bd-48fe-8f1d-589b2664d86b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:49.159149 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-0ebf8956-57bd-48fe-8f1d-589b2664d86b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1724 microversion: 2.20 time: 0.502352 Nov 02 14:41:49.161302 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 150/300] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:41:48 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1724 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:41:49.172906 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-90c013f6-9d2f-416a-9f98-0dc959e8c0aa tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:49.173887 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-90c013f6-9d2f-416a-9f98-0dc959e8c0aa tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:49.182434 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-90c013f6-9d2f-416a-9f98-0dc959e8c0aa tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:49.183203 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-90c013f6-9d2f-416a-9f98-0dc959e8c0aa tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:49.183887 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-90c013f6-9d2f-416a-9f98-0dc959e8c0aa tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:49.184769 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-90c013f6-9d2f-416a-9f98-0dc959e8c0aa tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:49.185442 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-90c013f6-9d2f-416a-9f98-0dc959e8c0aa tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:49.186072 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-90c013f6-9d2f-416a-9f98-0dc959e8c0aa tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:49.238155 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-1383f3fa-13e9-45c7-b91c-e166ee586e85 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:49.246317 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-1383f3fa-13e9-45c7-b91c-e166ee586e85 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f" status: 200 len: 1504 microversion: 2.1 time: 0.473137 Nov 02 14:41:49.247157 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 151/301] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:48 2022] GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f => generated 1504 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:41:49.280015 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-90c013f6-9d2f-416a-9f98-0dc959e8c0aa tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cc06a6df04ca4ab453de57ee84279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60a52ce75b94198ac6abb7727e7072d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:49.299641 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-90c013f6-9d2f-416a-9f98-0dc959e8c0aa tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7" status: 200 len: 1318 microversion: 2.1 time: 0.131096 Nov 02 14:41:49.300382 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 151/302] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:49 2022] GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7 => generated 1318 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:49.699990 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-acb704a3-3d28-4162-8b60-44547953c3d8 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:49.700618 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-acb704a3-3d28-4162-8b60-44547953c3d8 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:49.708014 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-acb704a3-3d28-4162-8b60-44547953c3d8 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:49.711231 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-acb704a3-3d28-4162-8b60-44547953c3d8 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:49.712606 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-acb704a3-3d28-4162-8b60-44547953c3d8 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:49.713391 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-acb704a3-3d28-4162-8b60-44547953c3d8 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:49.713863 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-acb704a3-3d28-4162-8b60-44547953c3d8 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:49.714289 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-acb704a3-3d28-4162-8b60-44547953c3d8 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:49.868565 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [req-91f36d6c-bdd4-471d-99e0-17962bb173f8 req-064e9c66-a916-428c-a456-2cc78e526168 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "400af7ba-398a-4908-8fea-f57eaa4e5a0f", "name": "network-vif-deleted", "tag": "c05cb546-bb19-48e2-bd44-b409f2203b29"}]} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:41:49.879855 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-acb704a3-3d28-4162-8b60-44547953c3d8 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:49.897742 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-acb704a3-3d28-4162-8b60-44547953c3d8 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91" status: 200 len: 1297 microversion: 2.1 time: 0.198991 Nov 02 14:41:49.898357 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 152/303] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:49 2022] GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 => generated 1297 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:49.910620 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-91f36d6c-bdd4-471d-99e0-17962bb173f8 req-064e9c66-a916-428c-a456-2cc78e526168 service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:49.910620 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-91f36d6c-bdd4-471d-99e0-17962bb173f8 req-064e9c66-a916-428c-a456-2cc78e526168 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:49.910620 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-91f36d6c-bdd4-471d-99e0-17962bb173f8 req-064e9c66-a916-428c-a456-2cc78e526168 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:49.935116 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.compute.server_external_events [req-91f36d6c-bdd4-471d-99e0-17962bb173f8 req-064e9c66-a916-428c-a456-2cc78e526168 service nova] Creating event network-vif-deleted:c05cb546-bb19-48e2-bd44-b409f2203b29 for instance 400af7ba-398a-4908-8fea-f57eaa4e5a0f on hv-cinder-86236 Nov 02 14:41:49.947689 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [req-91f36d6c-bdd4-471d-99e0-17962bb173f8 req-064e9c66-a916-428c-a456-2cc78e526168 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093959 Nov 02 14:41:49.952276 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 152/304] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:41:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:41:50.198994 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-1df2e88e-1bff-4a08-9735-ff04bc8b3d39 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:50.203271 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-1df2e88e-1bff-4a08-9735-ff04bc8b3d39 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:50.227092 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1df2e88e-1bff-4a08-9735-ff04bc8b3d39 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:50.228617 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1df2e88e-1bff-4a08-9735-ff04bc8b3d39 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:50.229454 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1df2e88e-1bff-4a08-9735-ff04bc8b3d39 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:50.233901 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1df2e88e-1bff-4a08-9735-ff04bc8b3d39 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:50.235434 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1df2e88e-1bff-4a08-9735-ff04bc8b3d39 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:50.238103 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1df2e88e-1bff-4a08-9735-ff04bc8b3d39 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:50.272962 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-e42a6bdd-a127-46bc-93ab-9664be22a967 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:50.274532 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-e42a6bdd-a127-46bc-93ab-9664be22a967 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: 400af7ba-398a-4908-8fea-f57eaa4e5a0f] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:50.284562 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e42a6bdd-a127-46bc-93ab-9664be22a967 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:50.285351 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e42a6bdd-a127-46bc-93ab-9664be22a967 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:50.285978 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e42a6bdd-a127-46bc-93ab-9664be22a967 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:50.286992 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e42a6bdd-a127-46bc-93ab-9664be22a967 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:50.287613 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e42a6bdd-a127-46bc-93ab-9664be22a967 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:50.288198 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e42a6bdd-a127-46bc-93ab-9664be22a967 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:50.465286 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-e42a6bdd-a127-46bc-93ab-9664be22a967 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:50.484766 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-e42a6bdd-a127-46bc-93ab-9664be22a967 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f" status: 200 len: 1299 microversion: 2.1 time: 0.213658 Nov 02 14:41:50.488569 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 153/305] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:50 2022] GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f => generated 1299 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:41:50.499898 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-9c10d85e-fbff-47c7-9ae5-76f2d9bf91f0 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:50.508851 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-9c10d85e-fbff-47c7-9ae5-76f2d9bf91f0 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:50.528773 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9c10d85e-fbff-47c7-9ae5-76f2d9bf91f0 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:50.542329 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9c10d85e-fbff-47c7-9ae5-76f2d9bf91f0 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:50.546939 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9c10d85e-fbff-47c7-9ae5-76f2d9bf91f0 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:50.552063 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9c10d85e-fbff-47c7-9ae5-76f2d9bf91f0 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:50.556624 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9c10d85e-fbff-47c7-9ae5-76f2d9bf91f0 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:50.559229 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9c10d85e-fbff-47c7-9ae5-76f2d9bf91f0 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:50.774630 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-1df2e88e-1bff-4a08-9735-ff04bc8b3d39 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:50.788418 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-1df2e88e-1bff-4a08-9735-ff04bc8b3d39 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:50.798183 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-1df2e88e-1bff-4a08-9735-ff04bc8b3d39 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:50.799914 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-1df2e88e-1bff-4a08-9735-ff04bc8b3d39 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1745 microversion: 2.20 time: 0.614618 Nov 02 14:41:50.800745 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 153/306] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:41:50 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1745 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:41:50.891453 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-9c10d85e-fbff-47c7-9ae5-76f2d9bf91f0 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cc06a6df04ca4ab453de57ee84279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60a52ce75b94198ac6abb7727e7072d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:50.908416 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-9c10d85e-fbff-47c7-9ae5-76f2d9bf91f0 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7" status: 200 len: 1358 microversion: 2.1 time: 0.410953 Nov 02 14:41:50.909398 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 154/307] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:50 2022] GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7 => generated 1358 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:50.928103 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-edee5e8a-e27a-4152-9d77-8910cbe75aa9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:50.928812 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-edee5e8a-e27a-4152-9d77-8910cbe75aa9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:50.936037 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-edee5e8a-e27a-4152-9d77-8910cbe75aa9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:50.936630 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-edee5e8a-e27a-4152-9d77-8910cbe75aa9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:50.938549 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-edee5e8a-e27a-4152-9d77-8910cbe75aa9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:50.938549 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-edee5e8a-e27a-4152-9d77-8910cbe75aa9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:50.938549 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-edee5e8a-e27a-4152-9d77-8910cbe75aa9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:50.939697 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-edee5e8a-e27a-4152-9d77-8910cbe75aa9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:50.946164 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell1:SELECT=100 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:41:51.058163 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-edee5e8a-e27a-4152-9d77-8910cbe75aa9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:51.069560 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-edee5e8a-e27a-4152-9d77-8910cbe75aa9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91" status: 200 len: 1305 microversion: 2.1 time: 0.144215 Nov 02 14:41:51.073047 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 154/308] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:50 2022] GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 => generated 1305 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:51.506030 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell0:SELECT=2 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:41:51.510664 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-ef32297c-f816-4a54-8646-e26bdecd999d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:51.514176 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-ef32297c-f816-4a54-8646-e26bdecd999d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: 400af7ba-398a-4908-8fea-f57eaa4e5a0f] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:51.523765 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ef32297c-f816-4a54-8646-e26bdecd999d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:51.524562 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ef32297c-f816-4a54-8646-e26bdecd999d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:51.525210 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ef32297c-f816-4a54-8646-e26bdecd999d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:51.526180 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ef32297c-f816-4a54-8646-e26bdecd999d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:51.526858 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ef32297c-f816-4a54-8646-e26bdecd999d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:51.527475 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ef32297c-f816-4a54-8646-e26bdecd999d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:51.598854 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ef32297c-f816-4a54-8646-e26bdecd999d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:51.599349 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ef32297c-f816-4a54-8646-e26bdecd999d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:51.599979 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ef32297c-f816-4a54-8646-e26bdecd999d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:51.600616 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.objects.instance [None req-ef32297c-f816-4a54-8646-e26bdecd999d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lazy-loading 'fault' on Instance uuid 400af7ba-398a-4908-8fea-f57eaa4e5a0f {{(pid=119659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:41:51.695546 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-ef32297c-f816-4a54-8646-e26bdecd999d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:51.709624 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-ef32297c-f816-4a54-8646-e26bdecd999d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f" status: 200 len: 1304 microversion: 2.1 time: 0.203160 Nov 02 14:41:51.711989 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 155/309] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:51 2022] GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f => generated 1304 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:51.832820 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-806f75c7-3b51-4c6c-9520-c1703365a9b7 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:51.834562 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-806f75c7-3b51-4c6c-9520-c1703365a9b7 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:51.836968 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:41:51.843662 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-806f75c7-3b51-4c6c-9520-c1703365a9b7 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:51.844460 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-806f75c7-3b51-4c6c-9520-c1703365a9b7 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:51.844990 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-806f75c7-3b51-4c6c-9520-c1703365a9b7 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:51.845792 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-806f75c7-3b51-4c6c-9520-c1703365a9b7 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:51.846263 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-806f75c7-3b51-4c6c-9520-c1703365a9b7 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:51.846696 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-806f75c7-3b51-4c6c-9520-c1703365a9b7 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:51.933360 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-adcdb7b6-db4e-4a9f-8bec-70dcbc89ac0c tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:51.933983 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-adcdb7b6-db4e-4a9f-8bec-70dcbc89ac0c tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:51.942132 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-adcdb7b6-db4e-4a9f-8bec-70dcbc89ac0c tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:51.942835 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-adcdb7b6-db4e-4a9f-8bec-70dcbc89ac0c tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:51.943441 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-adcdb7b6-db4e-4a9f-8bec-70dcbc89ac0c tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:51.944793 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-adcdb7b6-db4e-4a9f-8bec-70dcbc89ac0c tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:51.945456 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-adcdb7b6-db4e-4a9f-8bec-70dcbc89ac0c tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:51.946224 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-adcdb7b6-db4e-4a9f-8bec-70dcbc89ac0c tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:52.174656 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-806f75c7-3b51-4c6c-9520-c1703365a9b7 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:52.186611 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-806f75c7-3b51-4c6c-9520-c1703365a9b7 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:52.197755 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-806f75c7-3b51-4c6c-9520-c1703365a9b7 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:52.197755 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-806f75c7-3b51-4c6c-9520-c1703365a9b7 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1745 microversion: 2.20 time: 0.369538 Nov 02 14:41:52.201426 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 155/310] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:41:51 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1745 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:41:52.211656 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [req-ab4669af-9b05-4fd5-901e-2d71f968fc83 req-95d21ff3-de35-4c9f-bdd1-8f9c97b94a68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24d10c5a-012e-4d8a-8188-c2289e1605b7", "tag": "881c5e7e-3ed6-4eda-ba12-f2fc35e98f97"}]} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:41:52.224225 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-ab4669af-9b05-4fd5-901e-2d71f968fc83 req-95d21ff3-de35-4c9f-bdd1-8f9c97b94a68 service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:52.225020 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-ab4669af-9b05-4fd5-901e-2d71f968fc83 req-95d21ff3-de35-4c9f-bdd1-8f9c97b94a68 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:52.225718 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-ab4669af-9b05-4fd5-901e-2d71f968fc83 req-95d21ff3-de35-4c9f-bdd1-8f9c97b94a68 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:52.249194 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.compute.server_external_events [req-ab4669af-9b05-4fd5-901e-2d71f968fc83 req-95d21ff3-de35-4c9f-bdd1-8f9c97b94a68 service nova] Creating event network-changed:881c5e7e-3ed6-4eda-ba12-f2fc35e98f97 for instance 24d10c5a-012e-4d8a-8188-c2289e1605b7 on hv-cinder-86236 Nov 02 14:41:52.249194 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [req-ab4669af-9b05-4fd5-901e-2d71f968fc83 req-95d21ff3-de35-4c9f-bdd1-8f9c97b94a68 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044921 Nov 02 14:41:52.249194 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 156/311] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:41:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:41:52.267948 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-69934f5e-40f7-425f-9142-9214653ee452 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:52.267948 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-69934f5e-40f7-425f-9142-9214653ee452 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:52.274845 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-69934f5e-40f7-425f-9142-9214653ee452 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:52.275669 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-69934f5e-40f7-425f-9142-9214653ee452 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:52.276256 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-69934f5e-40f7-425f-9142-9214653ee452 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:52.277113 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-69934f5e-40f7-425f-9142-9214653ee452 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:52.277673 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-69934f5e-40f7-425f-9142-9214653ee452 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:52.278259 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-69934f5e-40f7-425f-9142-9214653ee452 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:52.354031 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-adcdb7b6-db4e-4a9f-8bec-70dcbc89ac0c tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cc06a6df04ca4ab453de57ee84279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60a52ce75b94198ac6abb7727e7072d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:52.363006 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-adcdb7b6-db4e-4a9f-8bec-70dcbc89ac0c tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7" status: 200 len: 1358 microversion: 2.1 time: 0.433154 Nov 02 14:41:52.367797 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 156/312] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:51 2022] GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7 => generated 1358 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:41:52.440299 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-69934f5e-40f7-425f-9142-9214653ee452 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:52.459968 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-69934f5e-40f7-425f-9142-9214653ee452 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91" status: 200 len: 1315 microversion: 2.1 time: 0.206016 Nov 02 14:41:52.460775 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 157/313] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:52 2022] GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:52.737614 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [req-8f310962-7c28-4d50-9af2-4b3ca1c55e3a req-09241d74-0765-4697-b027-b76daf8b293b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d0f8129-8155-4b7c-a462-f9c067ecfbca", "name": "network-vif-plugged", "status": "completed", "tag": "af3cc54b-a081-4f0c-aad1-a5c16e7530c7"}]} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:41:52.743807 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-89127601-07a0-4740-b4bd-c7ae27b4490d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:52.744632 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-89127601-07a0-4740-b4bd-c7ae27b4490d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: 400af7ba-398a-4908-8fea-f57eaa4e5a0f] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:52.770968 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-89127601-07a0-4740-b4bd-c7ae27b4490d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:52.771722 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-89127601-07a0-4740-b4bd-c7ae27b4490d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:52.785026 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-89127601-07a0-4740-b4bd-c7ae27b4490d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:52.786158 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-89127601-07a0-4740-b4bd-c7ae27b4490d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:52.786799 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-89127601-07a0-4740-b4bd-c7ae27b4490d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:52.786923 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-8f310962-7c28-4d50-9af2-4b3ca1c55e3a req-09241d74-0765-4697-b027-b76daf8b293b service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:52.789013 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-8f310962-7c28-4d50-9af2-4b3ca1c55e3a req-09241d74-0765-4697-b027-b76daf8b293b service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:52.789128 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-89127601-07a0-4740-b4bd-c7ae27b4490d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:52.789212 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-8f310962-7c28-4d50-9af2-4b3ca1c55e3a req-09241d74-0765-4697-b027-b76daf8b293b service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:52.831476 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.compute.server_external_events [req-8f310962-7c28-4d50-9af2-4b3ca1c55e3a req-09241d74-0765-4697-b027-b76daf8b293b service nova] Creating event network-vif-plugged:af3cc54b-a081-4f0c-aad1-a5c16e7530c7 for instance 5d0f8129-8155-4b7c-a462-f9c067ecfbca on hv-cinder-86236 Nov 02 14:41:52.842932 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [req-8f310962-7c28-4d50-9af2-4b3ca1c55e3a req-09241d74-0765-4697-b027-b76daf8b293b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117401 Nov 02 14:41:52.844899 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 157/314] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:41:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:41:52.885339 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-89127601-07a0-4740-b4bd-c7ae27b4490d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:52.886486 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-89127601-07a0-4740-b4bd-c7ae27b4490d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:52.887101 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-89127601-07a0-4740-b4bd-c7ae27b4490d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:52.887759 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.objects.instance [None req-89127601-07a0-4740-b4bd-c7ae27b4490d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lazy-loading 'fault' on Instance uuid 400af7ba-398a-4908-8fea-f57eaa4e5a0f {{(pid=119658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:41:53.164546 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-89127601-07a0-4740-b4bd-c7ae27b4490d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:53.169917 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-89127601-07a0-4740-b4bd-c7ae27b4490d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f" status: 200 len: 1304 microversion: 2.1 time: 0.430133 Nov 02 14:41:53.178748 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 158/315] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:52 2022] GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f => generated 1304 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:53.232031 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-67255b74-03cf-41e8-b719-ddd531dd945d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:53.232759 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-67255b74-03cf-41e8-b719-ddd531dd945d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:53.266094 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-67255b74-03cf-41e8-b719-ddd531dd945d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:53.268582 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-67255b74-03cf-41e8-b719-ddd531dd945d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:53.279919 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-67255b74-03cf-41e8-b719-ddd531dd945d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:53.281022 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-67255b74-03cf-41e8-b719-ddd531dd945d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:53.294929 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-67255b74-03cf-41e8-b719-ddd531dd945d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:53.294929 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-67255b74-03cf-41e8-b719-ddd531dd945d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:53.294929 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:41:53.392196 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-c74ac23f-a3cc-421b-98bf-e424fb92cc2a tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:53.392846 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-c74ac23f-a3cc-421b-98bf-e424fb92cc2a tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:53.403811 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c74ac23f-a3cc-421b-98bf-e424fb92cc2a tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:53.404511 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c74ac23f-a3cc-421b-98bf-e424fb92cc2a tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:53.405167 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c74ac23f-a3cc-421b-98bf-e424fb92cc2a tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:53.417634 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c74ac23f-a3cc-421b-98bf-e424fb92cc2a tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:53.417634 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c74ac23f-a3cc-421b-98bf-e424fb92cc2a tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:53.417634 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c74ac23f-a3cc-421b-98bf-e424fb92cc2a tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:53.770485 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-c74ac23f-a3cc-421b-98bf-e424fb92cc2a tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cc06a6df04ca4ab453de57ee84279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60a52ce75b94198ac6abb7727e7072d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:53.789765 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-c74ac23f-a3cc-421b-98bf-e424fb92cc2a tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7" status: 200 len: 1358 microversion: 2.1 time: 0.401548 Nov 02 14:41:53.805254 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 159/316] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:53 2022] GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7 => generated 1358 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:53.813086 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-e9434b17-e94b-4249-a0b2-b12c2e93bb22 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:53.814449 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-e9434b17-e94b-4249-a0b2-b12c2e93bb22 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:53.822042 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e9434b17-e94b-4249-a0b2-b12c2e93bb22 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:53.822865 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e9434b17-e94b-4249-a0b2-b12c2e93bb22 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:53.823484 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e9434b17-e94b-4249-a0b2-b12c2e93bb22 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:53.824403 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e9434b17-e94b-4249-a0b2-b12c2e93bb22 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:53.825101 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e9434b17-e94b-4249-a0b2-b12c2e93bb22 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:53.825694 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e9434b17-e94b-4249-a0b2-b12c2e93bb22 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:53.899527 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-67255b74-03cf-41e8-b719-ddd531dd945d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:53.911949 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-67255b74-03cf-41e8-b719-ddd531dd945d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:53.913472 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-67255b74-03cf-41e8-b719-ddd531dd945d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:53.921650 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-67255b74-03cf-41e8-b719-ddd531dd945d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1740 microversion: 2.20 time: 0.698073 Nov 02 14:41:53.922243 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 158/317] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:41:53 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1740 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:41:53.958999 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-e9434b17-e94b-4249-a0b2-b12c2e93bb22 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:53.971923 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-e9434b17-e94b-4249-a0b2-b12c2e93bb22 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91" status: 200 len: 1303 microversion: 2.1 time: 0.165312 Nov 02 14:41:53.985051 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 160/318] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:53 2022] GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 => generated 1303 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:54.210226 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-fbd65cd1-f630-4c03-863f-5a26cf272cf5 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:54.210226 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-fbd65cd1-f630-4c03-863f-5a26cf272cf5 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: 400af7ba-398a-4908-8fea-f57eaa4e5a0f] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:54.211859 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fbd65cd1-f630-4c03-863f-5a26cf272cf5 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:54.213271 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fbd65cd1-f630-4c03-863f-5a26cf272cf5 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:54.213708 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fbd65cd1-f630-4c03-863f-5a26cf272cf5 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:54.214453 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fbd65cd1-f630-4c03-863f-5a26cf272cf5 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:54.214879 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fbd65cd1-f630-4c03-863f-5a26cf272cf5 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:54.215297 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fbd65cd1-f630-4c03-863f-5a26cf272cf5 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:54.233757 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.wsgi [None req-fbd65cd1-f630-4c03-863f-5a26cf272cf5 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] HTTP exception thrown: Instance 400af7ba-398a-4908-8fea-f57eaa4e5a0f could not be found. Nov 02 14:41:54.236042 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-fbd65cd1-f630-4c03-863f-5a26cf272cf5 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Request method failure captured: Nov 02 14:41:54.236042 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: request: GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f HTTP/1.1 Nov 02 14:41:54.236042 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Accept: application/json Nov 02 14:41:54.236042 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Accept-Encoding: identity Nov 02 14:41:54.236042 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Connection: close Nov 02 14:41:54.236042 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Content-Length: 0 Nov 02 14:41:54.236042 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Content-Type: application/json Nov 02 14:41:54.236042 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Host: 10.222.0.30 Nov 02 14:41:54.236042 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Openstack-System-Scope: None Nov 02 14:41:54.236042 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: User-Agent: python-urllib3/1.26.12 Nov 02 14:41:54.236042 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Auth-Token: gAAAAABjYoGCCxQ3uvXjuXLajn8keqq7twS2jeBUN_5-Usj9kSj2EGLAJ2D33-Z_hUOuVcJFCHVPaNR-Q5qzzAKhe4k5F-9j42teYbSMow_MoF8Q3Z-AQWkb8ZtGJ1LW3lFz9ve5wfFUuMCIqD46ekOv8mj_3aVHbAuWMzxBNy-xu5ROjfv2M4U Nov 02 14:41:54.236042 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Domain-Id: None Nov 02 14:41:54.236042 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Domain-Name: None Nov 02 14:41:54.236042 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Identity-Status: Confirmed Nov 02 14:41:54.236042 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Is-Admin-Project: True Nov 02 14:41:54.236042 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Domain-Id: default Nov 02 14:41:54.236042 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Domain-Name: Default Nov 02 14:41:54.236042 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Id: 47b8cf11e60741e29dfec5f97c462eff Nov 02 14:41:54.236042 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Name: tempest-VolumesActionsTest-428532952 Nov 02 14:41:54.236042 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Role: reader,member Nov 02 14:41:54.236042 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Roles: reader,member Nov 02 14:41:54.254949 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/47b8cf11e60741e29dfec5f97c462eff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/47b8cf11e60741e29dfec5f97c462eff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/47b8cf11e60741e29dfec5f97c462eff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_47b8cf11e60741e29dfec5f97c462eff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:41:54.254949 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant: tempest-VolumesActionsTest-428532952 Nov 02 14:41:54.254949 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant-Id: 47b8cf11e60741e29dfec5f97c462eff Nov 02 14:41:54.254949 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant-Name: tempest-VolumesActionsTest-428532952 Nov 02 14:41:54.254949 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User: tempest-VolumesActionsTest-428532952-project Nov 02 14:41:54.254949 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Domain-Id: default Nov 02 14:41:54.254949 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Domain-Name: Default Nov 02 14:41:54.254949 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Id: c51fbcb1f2714d2c825266ec673348a0 Nov 02 14:41:54.254949 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Name: tempest-VolumesActionsTest-428532952-project Nov 02 14:41:54.254949 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: method: > Nov 02 14:41:54.254949 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: exception: Instance 400af7ba-398a-4908-8fea-f57eaa4e5a0f could not be found. Nov 02 14:41:54.254949 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: action_args: {'id': '400af7ba-398a-4908-8fea-f57eaa4e5a0f'} Nov 02 14:41:54.255952 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:41:54.255952 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:41:54.255952 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:41:54.255952 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:41:54.255952 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:41:54.255952 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:41:54.255952 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:41:54.255952 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:41:54.255952 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:41:54.255952 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:41:54.255952 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 400af7ba-398a-4908-8fea-f57eaa4e5a0f could not be found. Nov 02 14:41:54.255952 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:41:54.255952 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:41:54.255952 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:41:54.255952 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:41:54.255952 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:41:54.255952 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:41:54.255952 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:41:54.255952 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:41:54.255952 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:41:54.262670 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:41:54.262670 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:41:54.262670 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:41:54.262670 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:41:54.262670 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:41:54.262670 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:41:54.262670 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:41:54.262670 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 400af7ba-398a-4908-8fea-f57eaa4e5a0f could not be found. Nov 02 14:41:54.262670 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:41:54.262670 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:41:54.262670 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:41:54.262670 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:41:54.262670 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:41:54.262670 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:41:54.262670 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:41:54.262670 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:41:54.262670 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 400af7ba-398a-4908-8fea-f57eaa4e5a0f could not be found. Nov 02 14:41:54.262670 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:41:54.264793 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-fbd65cd1-f630-4c03-863f-5a26cf272cf5 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Returning 404 to user: Instance 400af7ba-398a-4908-8fea-f57eaa4e5a0f could not be found. {{(pid=119659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:41:54.264793 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-fbd65cd1-f630-4c03-863f-5a26cf272cf5 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f" status: 404 len: 111 microversion: 2.1 time: 0.040952 Nov 02 14:41:54.264793 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 159/319] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:54 2022] GET /compute/v2.1/servers/400af7ba-398a-4908-8fea-f57eaa4e5a0f => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:41:54.785720 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-6059a8ea-649d-4468-93d2-ea2f33237bee tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-48646359", "imageRef": "a726a246-cc7f-46e6-aeff-4d62e03cc091", "flavorRef": "452", "networks": [{"uuid": "5567c379-db86-4c8e-933e-4117b6a0d5fa"}]}} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:41:54.819772 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-d2c50baa-d2e1-4a13-a6fb-0244e7cabdf3 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:54.824526 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-d2c50baa-d2e1-4a13-a6fb-0244e7cabdf3 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:54.836052 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d2c50baa-d2e1-4a13-a6fb-0244e7cabdf3 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:54.837254 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d2c50baa-d2e1-4a13-a6fb-0244e7cabdf3 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:54.842893 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d2c50baa-d2e1-4a13-a6fb-0244e7cabdf3 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:54.845945 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d2c50baa-d2e1-4a13-a6fb-0244e7cabdf3 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:54.847755 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d2c50baa-d2e1-4a13-a6fb-0244e7cabdf3 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:54.848366 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d2c50baa-d2e1-4a13-a6fb-0244e7cabdf3 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:55.303352 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-d2c50baa-d2e1-4a13-a6fb-0244e7cabdf3 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cc06a6df04ca4ab453de57ee84279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60a52ce75b94198ac6abb7727e7072d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:55.303352 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-d2c50baa-d2e1-4a13-a6fb-0244e7cabdf3 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7" status: 200 len: 1358 microversion: 2.1 time: 0.470863 Nov 02 14:41:55.303352 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 160/320] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:54 2022] GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7 => generated 1358 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:55.318934 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-e140d01e-81c5-4e34-8599-45b926bc8133 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:55.329103 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-e140d01e-81c5-4e34-8599-45b926bc8133 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:55.344057 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e140d01e-81c5-4e34-8599-45b926bc8133 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:55.345552 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e140d01e-81c5-4e34-8599-45b926bc8133 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:55.346289 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e140d01e-81c5-4e34-8599-45b926bc8133 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:55.347413 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e140d01e-81c5-4e34-8599-45b926bc8133 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:55.351056 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e140d01e-81c5-4e34-8599-45b926bc8133 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:55.351695 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e140d01e-81c5-4e34-8599-45b926bc8133 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:56.021385 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-e140d01e-81c5-4e34-8599-45b926bc8133 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:56.036553 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-e140d01e-81c5-4e34-8599-45b926bc8133 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:56.038187 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-e140d01e-81c5-4e34-8599-45b926bc8133 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:56.039430 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-e140d01e-81c5-4e34-8599-45b926bc8133 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1740 microversion: 2.20 time: 0.734338 Nov 02 14:41:56.040955 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 161/321] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:41:55 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1740 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:41:56.045620 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-c7785afa-a212-4175-9676-514623dfded1 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:56.059679 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-c7785afa-a212-4175-9676-514623dfded1 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:56.075080 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c7785afa-a212-4175-9676-514623dfded1 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:56.076054 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c7785afa-a212-4175-9676-514623dfded1 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:56.080222 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c7785afa-a212-4175-9676-514623dfded1 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:56.081288 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c7785afa-a212-4175-9676-514623dfded1 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:56.081995 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c7785afa-a212-4175-9676-514623dfded1 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:56.087267 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c7785afa-a212-4175-9676-514623dfded1 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:56.331551 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-c7785afa-a212-4175-9676-514623dfded1 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:56.361115 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-c7785afa-a212-4175-9676-514623dfded1 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91" status: 200 len: 1371 microversion: 2.1 time: 0.316765 Nov 02 14:41:56.372703 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 162/322] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:56 2022] GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 => generated 1371 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:56.388798 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-bd48fadb-a6c4-47ee-9fc1-81bbe8c5299b tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:56.394270 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-bd48fadb-a6c4-47ee-9fc1-81bbe8c5299b tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:56.399232 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-bd48fadb-a6c4-47ee-9fc1-81bbe8c5299b tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:56.400043 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-bd48fadb-a6c4-47ee-9fc1-81bbe8c5299b tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:56.400671 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-bd48fadb-a6c4-47ee-9fc1-81bbe8c5299b tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:56.401785 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-bd48fadb-a6c4-47ee-9fc1-81bbe8c5299b tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:56.402516 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-bd48fadb-a6c4-47ee-9fc1-81bbe8c5299b tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:56.403237 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-bd48fadb-a6c4-47ee-9fc1-81bbe8c5299b tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:56.988369 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-bd48fadb-a6c4-47ee-9fc1-81bbe8c5299b tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cc06a6df04ca4ab453de57ee84279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60a52ce75b94198ac6abb7727e7072d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:57.006813 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-bd48fadb-a6c4-47ee-9fc1-81bbe8c5299b tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7" status: 200 len: 1358 microversion: 2.1 time: 0.642209 Nov 02 14:41:57.016313 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 163/323] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:56 2022] GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7 => generated 1358 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:57.080564 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-d6b38988-23d9-4f4e-9641-a91a3cb1ac05 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:57.085260 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-d6b38988-23d9-4f4e-9641-a91a3cb1ac05 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:57.107453 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d6b38988-23d9-4f4e-9641-a91a3cb1ac05 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:57.108029 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d6b38988-23d9-4f4e-9641-a91a3cb1ac05 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:57.108706 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d6b38988-23d9-4f4e-9641-a91a3cb1ac05 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:57.110661 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d6b38988-23d9-4f4e-9641-a91a3cb1ac05 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:57.111719 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d6b38988-23d9-4f4e-9641-a91a3cb1ac05 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:57.112472 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d6b38988-23d9-4f4e-9641-a91a3cb1ac05 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:57.187775 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell0:SELECT=4 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:41:57.452557 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-d6b38988-23d9-4f4e-9641-a91a3cb1ac05 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:57.472438 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-d6b38988-23d9-4f4e-9641-a91a3cb1ac05 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:57.476015 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-d6b38988-23d9-4f4e-9641-a91a3cb1ac05 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:57.478947 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-d6b38988-23d9-4f4e-9641-a91a3cb1ac05 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1740 microversion: 2.20 time: 0.404804 Nov 02 14:41:57.482032 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 164/324] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:41:57 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1740 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:41:57.496775 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [req-d7cc9bb1-6f30-482f-8ee4-6489f2537fce req-ddbd0128-3369-438c-8927-ac8e41855c0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d1d6b9a-4ef9-47db-b416-7a0a0f885d91", "tag": "fc1bebad-c267-4384-b8ba-b3d4c19799bd"}]} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:41:57.518607 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-d7cc9bb1-6f30-482f-8ee4-6489f2537fce req-ddbd0128-3369-438c-8927-ac8e41855c0e service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:57.522192 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-d7cc9bb1-6f30-482f-8ee4-6489f2537fce req-ddbd0128-3369-438c-8927-ac8e41855c0e service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:57.527927 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-d7cc9bb1-6f30-482f-8ee4-6489f2537fce req-ddbd0128-3369-438c-8927-ac8e41855c0e service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:57.541943 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell0:SELECT=24 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:41:57.562012 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.compute.server_external_events [req-d7cc9bb1-6f30-482f-8ee4-6489f2537fce req-ddbd0128-3369-438c-8927-ac8e41855c0e service nova] Creating event network-changed:fc1bebad-c267-4384-b8ba-b3d4c19799bd for instance 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 on hv-cinder-86236 Nov 02 14:41:57.582874 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [req-d7cc9bb1-6f30-482f-8ee4-6489f2537fce req-ddbd0128-3369-438c-8927-ac8e41855c0e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094776 Nov 02 14:41:57.585204 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 165/325] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:41:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:41:57.595268 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-48f56359-a71e-4a67-8a44-170412f458c9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:57.595268 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-48f56359-a71e-4a67-8a44-170412f458c9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:57.622003 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-48f56359-a71e-4a67-8a44-170412f458c9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:57.622682 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-48f56359-a71e-4a67-8a44-170412f458c9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:57.623193 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-48f56359-a71e-4a67-8a44-170412f458c9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:57.629228 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-48f56359-a71e-4a67-8a44-170412f458c9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:57.629228 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-48f56359-a71e-4a67-8a44-170412f458c9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:57.629228 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-48f56359-a71e-4a67-8a44-170412f458c9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:57.920181 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-48f56359-a71e-4a67-8a44-170412f458c9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:57.935711 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-48f56359-a71e-4a67-8a44-170412f458c9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91" status: 200 len: 1371 microversion: 2.1 time: 0.349219 Nov 02 14:41:57.937060 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 166/326] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:57 2022] GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 => generated 1371 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:58.067152 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-19da7d14-bb42-40e6-891f-04b72fcfa2d7 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:58.071331 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-19da7d14-bb42-40e6-891f-04b72fcfa2d7 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:58.097826 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-19da7d14-bb42-40e6-891f-04b72fcfa2d7 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:58.098364 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-19da7d14-bb42-40e6-891f-04b72fcfa2d7 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:58.100114 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-19da7d14-bb42-40e6-891f-04b72fcfa2d7 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:58.102247 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-19da7d14-bb42-40e6-891f-04b72fcfa2d7 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:58.102806 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-19da7d14-bb42-40e6-891f-04b72fcfa2d7 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:58.103305 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-19da7d14-bb42-40e6-891f-04b72fcfa2d7 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:58.708373 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-19da7d14-bb42-40e6-891f-04b72fcfa2d7 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cc06a6df04ca4ab453de57ee84279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60a52ce75b94198ac6abb7727e7072d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:58.723758 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-19da7d14-bb42-40e6-891f-04b72fcfa2d7 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7" status: 200 len: 1358 microversion: 2.1 time: 0.665839 Nov 02 14:41:58.737207 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 167/327] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:58 2022] GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7 => generated 1358 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:58.737207 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-dbb5c3fd-94fb-479b-a3d3-40bada47f1eb tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:58.737207 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-dbb5c3fd-94fb-479b-a3d3-40bada47f1eb tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:58.756364 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-dbb5c3fd-94fb-479b-a3d3-40bada47f1eb tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:58.757591 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-dbb5c3fd-94fb-479b-a3d3-40bada47f1eb tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:58.758237 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-dbb5c3fd-94fb-479b-a3d3-40bada47f1eb tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:58.759169 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-dbb5c3fd-94fb-479b-a3d3-40bada47f1eb tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:58.761330 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-dbb5c3fd-94fb-479b-a3d3-40bada47f1eb tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:58.761781 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-dbb5c3fd-94fb-479b-a3d3-40bada47f1eb tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:59.103441 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-dbb5c3fd-94fb-479b-a3d3-40bada47f1eb tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:59.115632 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-dbb5c3fd-94fb-479b-a3d3-40bada47f1eb tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:59.123323 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-dbb5c3fd-94fb-479b-a3d3-40bada47f1eb tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:59.130162 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-dbb5c3fd-94fb-479b-a3d3-40bada47f1eb tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1740 microversion: 2.20 time: 0.401051 Nov 02 14:41:59.137917 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 168/328] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:41:58 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1740 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:41:59.137917 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-c76ede83-ebf7-40e0-95df-334b9e18931c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:59.137917 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-c76ede83-ebf7-40e0-95df-334b9e18931c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:59.156377 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c76ede83-ebf7-40e0-95df-334b9e18931c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:59.157774 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c76ede83-ebf7-40e0-95df-334b9e18931c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:59.158776 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c76ede83-ebf7-40e0-95df-334b9e18931c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:59.160545 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c76ede83-ebf7-40e0-95df-334b9e18931c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:59.161425 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c76ede83-ebf7-40e0-95df-334b9e18931c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:59.162186 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c76ede83-ebf7-40e0-95df-334b9e18931c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:59.504101 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-c76ede83-ebf7-40e0-95df-334b9e18931c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:59.519659 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-c76ede83-ebf7-40e0-95df-334b9e18931c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91" status: 200 len: 1371 microversion: 2.1 time: 0.386938 Nov 02 14:41:59.520682 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 169/329] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:59 2022] GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 => generated 1371 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:59.752942 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-bcf89f6c-ffdb-418c-b6d0-515ca9bd054d tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:59.753771 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-bcf89f6c-ffdb-418c-b6d0-515ca9bd054d tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:59.759669 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-bcf89f6c-ffdb-418c-b6d0-515ca9bd054d tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:59.760159 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-bcf89f6c-ffdb-418c-b6d0-515ca9bd054d tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:59.760596 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-bcf89f6c-ffdb-418c-b6d0-515ca9bd054d tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:59.761330 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-bcf89f6c-ffdb-418c-b6d0-515ca9bd054d tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:59.761782 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-bcf89f6c-ffdb-418c-b6d0-515ca9bd054d tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:59.762203 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-bcf89f6c-ffdb-418c-b6d0-515ca9bd054d tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:00.005658 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-bcf89f6c-ffdb-418c-b6d0-515ca9bd054d tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cc06a6df04ca4ab453de57ee84279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60a52ce75b94198ac6abb7727e7072d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:00.013455 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-bcf89f6c-ffdb-418c-b6d0-515ca9bd054d tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7" status: 200 len: 1358 microversion: 2.1 time: 0.265184 Nov 02 14:42:00.014115 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 170/330] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:59 2022] GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7 => generated 1358 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:42:00.156333 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-a23ce886-ca58-44e0-9b4a-4a52d1c2bef5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:00.156934 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-a23ce886-ca58-44e0-9b4a-4a52d1c2bef5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:00.162911 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a23ce886-ca58-44e0-9b4a-4a52d1c2bef5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:00.163397 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a23ce886-ca58-44e0-9b4a-4a52d1c2bef5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:00.163831 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a23ce886-ca58-44e0-9b4a-4a52d1c2bef5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:00.164509 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a23ce886-ca58-44e0-9b4a-4a52d1c2bef5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:00.164959 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a23ce886-ca58-44e0-9b4a-4a52d1c2bef5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:00.165407 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a23ce886-ca58-44e0-9b4a-4a52d1c2bef5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:00.323206 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-a23ce886-ca58-44e0-9b4a-4a52d1c2bef5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:00.333858 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-a23ce886-ca58-44e0-9b4a-4a52d1c2bef5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:00.341730 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-a23ce886-ca58-44e0-9b4a-4a52d1c2bef5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:00.343878 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-a23ce886-ca58-44e0-9b4a-4a52d1c2bef5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1740 microversion: 2.20 time: 0.190697 Nov 02 14:42:00.344460 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 171/331] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:42:00 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1740 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:42:00.551673 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-11938ac3-0b2d-4908-b57c-34cf41b3f0cf tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:00.561510 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-11938ac3-0b2d-4908-b57c-34cf41b3f0cf tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:00.576197 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-11938ac3-0b2d-4908-b57c-34cf41b3f0cf tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:00.578744 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-11938ac3-0b2d-4908-b57c-34cf41b3f0cf tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:00.578744 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-11938ac3-0b2d-4908-b57c-34cf41b3f0cf tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:00.579271 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-11938ac3-0b2d-4908-b57c-34cf41b3f0cf tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:00.579931 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-11938ac3-0b2d-4908-b57c-34cf41b3f0cf tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:00.592264 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-11938ac3-0b2d-4908-b57c-34cf41b3f0cf tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:00.794521 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-11938ac3-0b2d-4908-b57c-34cf41b3f0cf tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:00.805319 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-11938ac3-0b2d-4908-b57c-34cf41b3f0cf tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91" status: 200 len: 1371 microversion: 2.1 time: 0.262263 Nov 02 14:42:00.806127 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 172/332] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:00 2022] GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 => generated 1371 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:01.040085 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-c664a212-fce5-4d74-82bf-66d66994ccc5 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:01.040820 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-c664a212-fce5-4d74-82bf-66d66994ccc5 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:01.045972 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:42:01.051230 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c664a212-fce5-4d74-82bf-66d66994ccc5 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:01.051881 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c664a212-fce5-4d74-82bf-66d66994ccc5 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:01.052416 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c664a212-fce5-4d74-82bf-66d66994ccc5 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:01.053280 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c664a212-fce5-4d74-82bf-66d66994ccc5 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:01.053802 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c664a212-fce5-4d74-82bf-66d66994ccc5 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:01.054297 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c664a212-fce5-4d74-82bf-66d66994ccc5 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:01.266556 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-c664a212-fce5-4d74-82bf-66d66994ccc5 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cc06a6df04ca4ab453de57ee84279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60a52ce75b94198ac6abb7727e7072d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:01.283588 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-c664a212-fce5-4d74-82bf-66d66994ccc5 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7" status: 200 len: 1358 microversion: 2.1 time: 0.246852 Nov 02 14:42:01.288661 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 173/333] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:01 2022] GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7 => generated 1358 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:42:01.380634 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-f688d859-de14-4512-be71-a3411cf87f3f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:01.384920 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-f688d859-de14-4512-be71-a3411cf87f3f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:01.428251 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f688d859-de14-4512-be71-a3411cf87f3f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:01.441235 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f688d859-de14-4512-be71-a3411cf87f3f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:01.441235 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f688d859-de14-4512-be71-a3411cf87f3f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:01.441235 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f688d859-de14-4512-be71-a3411cf87f3f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:01.441235 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f688d859-de14-4512-be71-a3411cf87f3f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:01.441941 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f688d859-de14-4512-be71-a3411cf87f3f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:01.634117 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-f688d859-de14-4512-be71-a3411cf87f3f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:01.646021 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-f688d859-de14-4512-be71-a3411cf87f3f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:01.648137 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-f688d859-de14-4512-be71-a3411cf87f3f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:01.649531 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-f688d859-de14-4512-be71-a3411cf87f3f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1740 microversion: 2.20 time: 0.277087 Nov 02 14:42:01.654986 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 174/334] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:42:01 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1740 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:42:01.832474 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-093db9e8-7953-4df0-b05c-832393564279 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:01.833169 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-093db9e8-7953-4df0-b05c-832393564279 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:01.857780 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-093db9e8-7953-4df0-b05c-832393564279 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:01.857780 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-093db9e8-7953-4df0-b05c-832393564279 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:01.857780 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-093db9e8-7953-4df0-b05c-832393564279 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:01.863575 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-093db9e8-7953-4df0-b05c-832393564279 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:01.864660 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-093db9e8-7953-4df0-b05c-832393564279 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:01.865288 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-093db9e8-7953-4df0-b05c-832393564279 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:02.185713 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-093db9e8-7953-4df0-b05c-832393564279 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:02.219731 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-093db9e8-7953-4df0-b05c-832393564279 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91" status: 200 len: 1371 microversion: 2.1 time: 0.391668 Nov 02 14:42:02.224945 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 175/335] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:01 2022] GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 => generated 1371 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:42:02.327502 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-7ad954a3-c2fa-4185-9083-0dbf2cb9bd99 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:02.328645 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-7ad954a3-c2fa-4185-9083-0dbf2cb9bd99 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:02.363886 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7ad954a3-c2fa-4185-9083-0dbf2cb9bd99 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:02.367302 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7ad954a3-c2fa-4185-9083-0dbf2cb9bd99 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:02.376932 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7ad954a3-c2fa-4185-9083-0dbf2cb9bd99 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:02.381453 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7ad954a3-c2fa-4185-9083-0dbf2cb9bd99 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:02.389072 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7ad954a3-c2fa-4185-9083-0dbf2cb9bd99 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:02.395943 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7ad954a3-c2fa-4185-9083-0dbf2cb9bd99 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:02.410012 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell1:SELECT=100 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:42:02.759549 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-7ad954a3-c2fa-4185-9083-0dbf2cb9bd99 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cc06a6df04ca4ab453de57ee84279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60a52ce75b94198ac6abb7727e7072d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:02.768035 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-7ad954a3-c2fa-4185-9083-0dbf2cb9bd99 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7" status: 200 len: 1358 microversion: 2.1 time: 0.446239 Nov 02 14:42:02.768596 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 176/336] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:02 2022] GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7 => generated 1358 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:02.773208 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-e4056c5e-8cf9-47d6-9de9-9970bafca258 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:02.773796 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-e4056c5e-8cf9-47d6-9de9-9970bafca258 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:02.779567 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e4056c5e-8cf9-47d6-9de9-9970bafca258 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:02.780042 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e4056c5e-8cf9-47d6-9de9-9970bafca258 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:02.780488 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e4056c5e-8cf9-47d6-9de9-9970bafca258 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:02.781194 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e4056c5e-8cf9-47d6-9de9-9970bafca258 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:02.781652 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e4056c5e-8cf9-47d6-9de9-9970bafca258 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:02.782091 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e4056c5e-8cf9-47d6-9de9-9970bafca258 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:02.994531 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-e4056c5e-8cf9-47d6-9de9-9970bafca258 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:03.004308 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-e4056c5e-8cf9-47d6-9de9-9970bafca258 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:03.006112 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-e4056c5e-8cf9-47d6-9de9-9970bafca258 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:03.007519 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-e4056c5e-8cf9-47d6-9de9-9970bafca258 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1740 microversion: 2.20 time: 0.237988 Nov 02 14:42:03.021504 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 177/337] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:42:02 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1740 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:42:03.257215 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-c724193c-b90d-4790-ad2f-c408acad687a tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:03.257890 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-c724193c-b90d-4790-ad2f-c408acad687a tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:03.280271 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c724193c-b90d-4790-ad2f-c408acad687a tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:03.280774 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c724193c-b90d-4790-ad2f-c408acad687a tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:03.283382 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c724193c-b90d-4790-ad2f-c408acad687a tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:03.284429 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c724193c-b90d-4790-ad2f-c408acad687a tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:03.285103 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c724193c-b90d-4790-ad2f-c408acad687a tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:03.287528 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c724193c-b90d-4790-ad2f-c408acad687a tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:03.611014 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-c724193c-b90d-4790-ad2f-c408acad687a tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:03.637953 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-c724193c-b90d-4790-ad2f-c408acad687a tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91" status: 200 len: 1371 microversion: 2.1 time: 0.387177 Nov 02 14:42:03.638559 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 178/338] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:03 2022] GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 => generated 1371 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:42:03.814970 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-ee5dd419-35c8-47d0-b33e-0c751980cf0c tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:03.816012 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-ee5dd419-35c8-47d0-b33e-0c751980cf0c tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:03.825344 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ee5dd419-35c8-47d0-b33e-0c751980cf0c tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:03.832234 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ee5dd419-35c8-47d0-b33e-0c751980cf0c tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:03.832234 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ee5dd419-35c8-47d0-b33e-0c751980cf0c tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:03.832234 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ee5dd419-35c8-47d0-b33e-0c751980cf0c tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:03.832234 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ee5dd419-35c8-47d0-b33e-0c751980cf0c tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:03.832584 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ee5dd419-35c8-47d0-b33e-0c751980cf0c tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:03.963579 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell1:SELECT=38 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:42:04.124780 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-ee5dd419-35c8-47d0-b33e-0c751980cf0c tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cc06a6df04ca4ab453de57ee84279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60a52ce75b94198ac6abb7727e7072d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:04.136996 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-ee5dd419-35c8-47d0-b33e-0c751980cf0c tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7" status: 200 len: 1358 microversion: 2.1 time: 0.326748 Nov 02 14:42:04.138567 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 179/339] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:03 2022] GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7 => generated 1358 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:42:04.145867 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-5942260f-f53a-4ae5-a61e-02471b1ed55f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:04.146849 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-5942260f-f53a-4ae5-a61e-02471b1ed55f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:04.154856 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5942260f-f53a-4ae5-a61e-02471b1ed55f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:04.155620 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5942260f-f53a-4ae5-a61e-02471b1ed55f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:04.157500 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5942260f-f53a-4ae5-a61e-02471b1ed55f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:04.158921 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5942260f-f53a-4ae5-a61e-02471b1ed55f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:04.159807 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5942260f-f53a-4ae5-a61e-02471b1ed55f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:04.160525 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5942260f-f53a-4ae5-a61e-02471b1ed55f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:04.368893 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-5942260f-f53a-4ae5-a61e-02471b1ed55f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:04.389367 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-5942260f-f53a-4ae5-a61e-02471b1ed55f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:04.389367 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-5942260f-f53a-4ae5-a61e-02471b1ed55f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:04.389367 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-5942260f-f53a-4ae5-a61e-02471b1ed55f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1740 microversion: 2.20 time: 0.243313 Nov 02 14:42:04.389806 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 180/340] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:42:04 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1740 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:42:04.665268 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-eef4e986-65b5-456c-9bcd-6d0621b587fc tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:04.665885 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-eef4e986-65b5-456c-9bcd-6d0621b587fc tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:04.672358 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-eef4e986-65b5-456c-9bcd-6d0621b587fc tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:04.674995 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-eef4e986-65b5-456c-9bcd-6d0621b587fc tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:04.674995 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-eef4e986-65b5-456c-9bcd-6d0621b587fc tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:04.674995 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-eef4e986-65b5-456c-9bcd-6d0621b587fc tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:04.674995 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-eef4e986-65b5-456c-9bcd-6d0621b587fc tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:04.675377 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-eef4e986-65b5-456c-9bcd-6d0621b587fc tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:04.813423 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_api:SELECT=15 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:42:04.920115 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-eef4e986-65b5-456c-9bcd-6d0621b587fc tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:04.931358 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-eef4e986-65b5-456c-9bcd-6d0621b587fc tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91" status: 200 len: 1371 microversion: 2.1 time: 0.269781 Nov 02 14:42:04.932358 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 181/341] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:04 2022] GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 => generated 1371 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:05.167823 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-8faa4140-1c47-4d53-b6aa-ff81a70956be tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:05.168554 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-8faa4140-1c47-4d53-b6aa-ff81a70956be tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:05.183094 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8faa4140-1c47-4d53-b6aa-ff81a70956be tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:05.183094 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8faa4140-1c47-4d53-b6aa-ff81a70956be tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:05.183094 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8faa4140-1c47-4d53-b6aa-ff81a70956be tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:05.183094 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8faa4140-1c47-4d53-b6aa-ff81a70956be tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:05.184068 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8faa4140-1c47-4d53-b6aa-ff81a70956be tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:05.184068 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8faa4140-1c47-4d53-b6aa-ff81a70956be tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:05.348621 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-8faa4140-1c47-4d53-b6aa-ff81a70956be tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cc06a6df04ca4ab453de57ee84279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60a52ce75b94198ac6abb7727e7072d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:05.356170 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-8faa4140-1c47-4d53-b6aa-ff81a70956be tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7" status: 200 len: 1358 microversion: 2.1 time: 0.192328 Nov 02 14:42:05.356979 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 182/342] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:05 2022] GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7 => generated 1358 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:42:05.411108 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-5f2c5744-4edc-457d-ac5c-de3b1f5b73d8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:05.417771 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-5f2c5744-4edc-457d-ac5c-de3b1f5b73d8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:05.418061 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5f2c5744-4edc-457d-ac5c-de3b1f5b73d8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:05.418564 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5f2c5744-4edc-457d-ac5c-de3b1f5b73d8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:05.419019 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5f2c5744-4edc-457d-ac5c-de3b1f5b73d8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:05.419760 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5f2c5744-4edc-457d-ac5c-de3b1f5b73d8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:05.420255 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5f2c5744-4edc-457d-ac5c-de3b1f5b73d8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:05.420697 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5f2c5744-4edc-457d-ac5c-de3b1f5b73d8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:05.583048 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-5f2c5744-4edc-457d-ac5c-de3b1f5b73d8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:05.592546 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-5f2c5744-4edc-457d-ac5c-de3b1f5b73d8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:05.594199 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-5f2c5744-4edc-457d-ac5c-de3b1f5b73d8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:05.596186 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-5f2c5744-4edc-457d-ac5c-de3b1f5b73d8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1740 microversion: 2.20 time: 0.189193 Nov 02 14:42:05.596858 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 183/343] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:42:05 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1740 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:42:05.956235 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-1be7ba50-232a-4e2b-bac9-b27614ba348f tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:05.957699 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-1be7ba50-232a-4e2b-bac9-b27614ba348f tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:05.973740 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1be7ba50-232a-4e2b-bac9-b27614ba348f tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:05.977406 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1be7ba50-232a-4e2b-bac9-b27614ba348f tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:05.978609 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1be7ba50-232a-4e2b-bac9-b27614ba348f tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:05.979599 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1be7ba50-232a-4e2b-bac9-b27614ba348f tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:05.982238 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1be7ba50-232a-4e2b-bac9-b27614ba348f tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:05.982855 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1be7ba50-232a-4e2b-bac9-b27614ba348f tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:06.324544 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-1be7ba50-232a-4e2b-bac9-b27614ba348f tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:06.335301 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-1be7ba50-232a-4e2b-bac9-b27614ba348f tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91" status: 200 len: 1371 microversion: 2.1 time: 0.383095 Nov 02 14:42:06.353667 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 184/344] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:05 2022] GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 => generated 1371 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:42:06.380938 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-b2b914b3-eb3a-4d95-abd1-afcebe215708 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:06.383092 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-b2b914b3-eb3a-4d95-abd1-afcebe215708 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:06.407425 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b2b914b3-eb3a-4d95-abd1-afcebe215708 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:06.407425 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b2b914b3-eb3a-4d95-abd1-afcebe215708 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:06.407425 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b2b914b3-eb3a-4d95-abd1-afcebe215708 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:06.407425 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b2b914b3-eb3a-4d95-abd1-afcebe215708 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:06.407824 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b2b914b3-eb3a-4d95-abd1-afcebe215708 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:06.407824 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b2b914b3-eb3a-4d95-abd1-afcebe215708 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:06.644514 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-b2b914b3-eb3a-4d95-abd1-afcebe215708 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cc06a6df04ca4ab453de57ee84279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60a52ce75b94198ac6abb7727e7072d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:06.654618 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.network.neutron [None req-6059a8ea-649d-4468-93d2-ea2f33237bee tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] validate_networks() for [('5567c379-db86-4c8e-933e-4117b6a0d5fa', None, None, None, None, None)] {{(pid=119658) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:42:06.685143 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-b2b914b3-eb3a-4d95-abd1-afcebe215708 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7" status: 200 len: 1358 microversion: 2.1 time: 0.294117 Nov 02 14:42:06.688065 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 185/345] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:06 2022] GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7 => generated 1358 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:06.691175 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-7cb86177-3f4c-49c9-b8b4-33548ac765ce tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:06.691784 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-7cb86177-3f4c-49c9-b8b4-33548ac765ce tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:06.711886 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7cb86177-3f4c-49c9-b8b4-33548ac765ce tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:06.716629 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7cb86177-3f4c-49c9-b8b4-33548ac765ce tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:06.716629 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7cb86177-3f4c-49c9-b8b4-33548ac765ce tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:06.716629 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7cb86177-3f4c-49c9-b8b4-33548ac765ce tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:06.716629 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7cb86177-3f4c-49c9-b8b4-33548ac765ce tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:06.716950 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7cb86177-3f4c-49c9-b8b4-33548ac765ce tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:07.047362 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-7cb86177-3f4c-49c9-b8b4-33548ac765ce tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:07.057343 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-7cb86177-3f4c-49c9-b8b4-33548ac765ce tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:07.060475 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-7cb86177-3f4c-49c9-b8b4-33548ac765ce tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:07.061927 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-7cb86177-3f4c-49c9-b8b4-33548ac765ce tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1740 microversion: 2.20 time: 0.374768 Nov 02 14:42:07.063007 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 186/346] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:42:06 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1740 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:42:07.070086 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [req-e71bb8c2-6f03-442b-991b-934c2c46b62d req-4644969f-bde1-418f-960f-eb4d2aa013b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d1d6b9a-4ef9-47db-b416-7a0a0f885d91", "name": "network-vif-plugged", "status": "completed", "tag": "fc1bebad-c267-4384-b8ba-b3d4c19799bd"}]} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:42:07.083101 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-e71bb8c2-6f03-442b-991b-934c2c46b62d req-4644969f-bde1-418f-960f-eb4d2aa013b4 service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:07.083960 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-e71bb8c2-6f03-442b-991b-934c2c46b62d req-4644969f-bde1-418f-960f-eb4d2aa013b4 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:07.084580 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-e71bb8c2-6f03-442b-991b-934c2c46b62d req-4644969f-bde1-418f-960f-eb4d2aa013b4 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:07.100499 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.compute.server_external_events [req-e71bb8c2-6f03-442b-991b-934c2c46b62d req-4644969f-bde1-418f-960f-eb4d2aa013b4 service nova] Creating event network-vif-plugged:fc1bebad-c267-4384-b8ba-b3d4c19799bd for instance 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 on hv-cinder-86236 Nov 02 14:42:07.108345 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [req-e71bb8c2-6f03-442b-991b-934c2c46b62d req-4644969f-bde1-418f-960f-eb4d2aa013b4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042924 Nov 02 14:42:07.108938 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 187/347] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:42:07.267490 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-6059a8ea-649d-4468-93d2-ea2f33237bee tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Flavor limits 0:0:0 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:42:07.267490 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-6059a8ea-649d-4468-93d2-ea2f33237bee tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Image limits 0:0:0 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:42:07.267490 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-6059a8ea-649d-4468-93d2-ea2f33237bee tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Flavor pref 0:0:0 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:42:07.267490 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-6059a8ea-649d-4468-93d2-ea2f33237bee tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Image pref 0:0:0 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:42:07.267844 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-6059a8ea-649d-4468-93d2-ea2f33237bee tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:42:07.282168 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6059a8ea-649d-4468-93d2-ea2f33237bee tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:07.282961 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6059a8ea-649d-4468-93d2-ea2f33237bee tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:07.283689 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6059a8ea-649d-4468-93d2-ea2f33237bee tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:07.285707 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6059a8ea-649d-4468-93d2-ea2f33237bee tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:07.286326 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6059a8ea-649d-4468-93d2-ea2f33237bee tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:07.286905 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6059a8ea-649d-4468-93d2-ea2f33237bee tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:07.321176 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.quota [None req-6059a8ea-649d-4468-93d2-ea2f33237bee tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Getting quotas for project 47b8cf11e60741e29dfec5f97c462eff. Resources: {'instances', 'ram', 'cores'} {{(pid=119658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:42:07.321176 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.quota [None req-6059a8ea-649d-4468-93d2-ea2f33237bee tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Getting quotas for user c51fbcb1f2714d2c825266ec673348a0 and project 47b8cf11e60741e29dfec5f97c462eff. Resources: {'instances', 'ram', 'cores'} {{(pid=119658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:42:07.363335 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-6059a8ea-649d-4468-93d2-ea2f33237bee tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Going to run 1 instances... {{(pid=119658) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:42:07.364693 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-faf25844-ed8a-4f94-a336-b81665aa10f9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:07.365663 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-faf25844-ed8a-4f94-a336-b81665aa10f9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:07.369249 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-6059a8ea-649d-4468-93d2-ea2f33237bee tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: bd91069f-ef45-44b0-a9c8-022d089d2dff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a726a246-cc7f-46e6-aeff-4d62e03cc091',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119658) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:42:07.396509 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-faf25844-ed8a-4f94-a336-b81665aa10f9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:07.397024 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-faf25844-ed8a-4f94-a336-b81665aa10f9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:07.397469 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-faf25844-ed8a-4f94-a336-b81665aa10f9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:07.401501 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-faf25844-ed8a-4f94-a336-b81665aa10f9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:07.404314 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-faf25844-ed8a-4f94-a336-b81665aa10f9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:07.406228 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-faf25844-ed8a-4f94-a336-b81665aa10f9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:07.584437 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-6059a8ea-649d-4468-93d2-ea2f33237bee tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 12.803367 Nov 02 14:42:07.587697 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 161/348] 10.222.0.30 () {60 vars in 1147 bytes} [Wed Nov 2 14:41:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 12807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:42:07.601555 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-541205de-ebd2-47a9-8998-900b89362b9b tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:07.601980 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-541205de-ebd2-47a9-8998-900b89362b9b tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: bd91069f-ef45-44b0-a9c8-022d089d2dff] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:07.733695 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-faf25844-ed8a-4f94-a336-b81665aa10f9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:07.735458 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-541205de-ebd2-47a9-8998-900b89362b9b tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:07.747095 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-541205de-ebd2-47a9-8998-900b89362b9b tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff" status: 200 len: 1212 microversion: 2.1 time: 0.150142 Nov 02 14:42:07.755804 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-faf25844-ed8a-4f94-a336-b81665aa10f9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91" status: 200 len: 1371 microversion: 2.1 time: 0.387939 Nov 02 14:42:07.755958 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 162/349] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:07 2022] GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff => generated 1212 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:07.756061 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 188/350] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:07 2022] GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 => generated 1371 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:42:07.756147 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-67cdca2b-3530-4479-bec6-725ea22eeb28 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:07.756147 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-67cdca2b-3530-4479-bec6-725ea22eeb28 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:07.766710 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-67cdca2b-3530-4479-bec6-725ea22eeb28 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:07.768114 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-67cdca2b-3530-4479-bec6-725ea22eeb28 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:07.768430 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-67cdca2b-3530-4479-bec6-725ea22eeb28 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:07.769489 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-67cdca2b-3530-4479-bec6-725ea22eeb28 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:07.770595 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-67cdca2b-3530-4479-bec6-725ea22eeb28 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:07.771560 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-67cdca2b-3530-4479-bec6-725ea22eeb28 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:08.012322 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-67cdca2b-3530-4479-bec6-725ea22eeb28 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cc06a6df04ca4ab453de57ee84279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60a52ce75b94198ac6abb7727e7072d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:08.023293 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-67cdca2b-3530-4479-bec6-725ea22eeb28 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7" status: 200 len: 1358 microversion: 2.1 time: 0.273576 Nov 02 14:42:08.045439 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 163/351] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:07 2022] GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7 => generated 1358 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:08.103342 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-96c2ae33-4ebe-4e54-9be9-72b4f9844c81 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:08.103342 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-96c2ae33-4ebe-4e54-9be9-72b4f9844c81 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:08.103342 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-96c2ae33-4ebe-4e54-9be9-72b4f9844c81 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:08.103342 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-96c2ae33-4ebe-4e54-9be9-72b4f9844c81 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:08.103700 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-96c2ae33-4ebe-4e54-9be9-72b4f9844c81 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:08.107723 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-96c2ae33-4ebe-4e54-9be9-72b4f9844c81 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:08.107723 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-96c2ae33-4ebe-4e54-9be9-72b4f9844c81 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:08.107723 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-96c2ae33-4ebe-4e54-9be9-72b4f9844c81 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:08.419559 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-96c2ae33-4ebe-4e54-9be9-72b4f9844c81 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:08.439615 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-96c2ae33-4ebe-4e54-9be9-72b4f9844c81 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:08.443061 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-96c2ae33-4ebe-4e54-9be9-72b4f9844c81 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:08.446070 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-96c2ae33-4ebe-4e54-9be9-72b4f9844c81 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1740 microversion: 2.20 time: 0.358148 Nov 02 14:42:08.467327 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 189/352] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:42:08 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1740 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:42:08.779205 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-0f611f69-ef4c-4c4c-a901-2c868f11679b tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:08.783777 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-0f611f69-ef4c-4c4c-a901-2c868f11679b tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: bd91069f-ef45-44b0-a9c8-022d089d2dff] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:08.784553 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-638fe4ea-25e2-4839-bf9c-f06d1c58dd75 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:08.793342 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-638fe4ea-25e2-4839-bf9c-f06d1c58dd75 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:08.803264 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-638fe4ea-25e2-4839-bf9c-f06d1c58dd75 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:08.805722 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-638fe4ea-25e2-4839-bf9c-f06d1c58dd75 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:08.809515 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-638fe4ea-25e2-4839-bf9c-f06d1c58dd75 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:08.812208 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-638fe4ea-25e2-4839-bf9c-f06d1c58dd75 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:08.812949 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-638fe4ea-25e2-4839-bf9c-f06d1c58dd75 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:08.816366 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-638fe4ea-25e2-4839-bf9c-f06d1c58dd75 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:08.877020 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-0f611f69-ef4c-4c4c-a901-2c868f11679b tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:08.888596 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-0f611f69-ef4c-4c4c-a901-2c868f11679b tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff" status: 200 len: 1212 microversion: 2.1 time: 0.116479 Nov 02 14:42:08.889551 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 164/353] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:08 2022] GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff => generated 1212 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:09.060120 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-1e0d86f9-6ea9-409d-9ab0-03932ed3af5a tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:09.062076 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-1e0d86f9-6ea9-409d-9ab0-03932ed3af5a tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:09.089283 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1e0d86f9-6ea9-409d-9ab0-03932ed3af5a tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:09.089555 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-638fe4ea-25e2-4839-bf9c-f06d1c58dd75 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:09.089692 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1e0d86f9-6ea9-409d-9ab0-03932ed3af5a tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:09.089692 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1e0d86f9-6ea9-409d-9ab0-03932ed3af5a tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:09.089692 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1e0d86f9-6ea9-409d-9ab0-03932ed3af5a tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:09.089692 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1e0d86f9-6ea9-409d-9ab0-03932ed3af5a tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:09.092740 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1e0d86f9-6ea9-409d-9ab0-03932ed3af5a tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:09.102835 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-638fe4ea-25e2-4839-bf9c-f06d1c58dd75 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91" status: 200 len: 1371 microversion: 2.1 time: 0.329391 Nov 02 14:42:09.123693 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 190/354] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:08 2022] GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 => generated 1371 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:09.330598 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-1e0d86f9-6ea9-409d-9ab0-03932ed3af5a tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cc06a6df04ca4ab453de57ee84279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60a52ce75b94198ac6abb7727e7072d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:09.340962 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-1e0d86f9-6ea9-409d-9ab0-03932ed3af5a tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7" status: 200 len: 1358 microversion: 2.1 time: 0.292810 Nov 02 14:42:09.342356 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 165/355] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:09 2022] GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7 => generated 1358 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:09.485249 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-427b6609-0dba-4457-8adb-d579c44fbb87 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:09.639579 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-427b6609-0dba-4457-8adb-d579c44fbb87 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:09.639579 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-427b6609-0dba-4457-8adb-d579c44fbb87 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:09.639579 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-427b6609-0dba-4457-8adb-d579c44fbb87 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:09.639579 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-427b6609-0dba-4457-8adb-d579c44fbb87 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:09.640134 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-427b6609-0dba-4457-8adb-d579c44fbb87 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:09.640134 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-427b6609-0dba-4457-8adb-d579c44fbb87 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:09.640134 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-427b6609-0dba-4457-8adb-d579c44fbb87 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:09.699199 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-427b6609-0dba-4457-8adb-d579c44fbb87 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:09.708354 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-427b6609-0dba-4457-8adb-d579c44fbb87 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:09.711019 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-427b6609-0dba-4457-8adb-d579c44fbb87 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:09.713860 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-427b6609-0dba-4457-8adb-d579c44fbb87 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1740 microversion: 2.20 time: 0.231995 Nov 02 14:42:09.714552 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 191/356] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:42:09 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1740 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:42:09.915126 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-18271f3c-88ce-4e2c-8b94-d29929f03d24 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:09.915731 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-18271f3c-88ce-4e2c-8b94-d29929f03d24 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: bd91069f-ef45-44b0-a9c8-022d089d2dff] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:09.921975 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-18271f3c-88ce-4e2c-8b94-d29929f03d24 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:09.922461 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-18271f3c-88ce-4e2c-8b94-d29929f03d24 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:09.922899 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-18271f3c-88ce-4e2c-8b94-d29929f03d24 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:09.923593 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-18271f3c-88ce-4e2c-8b94-d29929f03d24 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:09.924043 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-18271f3c-88ce-4e2c-8b94-d29929f03d24 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:09.924463 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-18271f3c-88ce-4e2c-8b94-d29929f03d24 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:09.990720 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-18271f3c-88ce-4e2c-8b94-d29929f03d24 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:10.000694 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-18271f3c-88ce-4e2c-8b94-d29929f03d24 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff" status: 200 len: 1216 microversion: 2.1 time: 0.089374 Nov 02 14:42:10.001892 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 166/357] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:09 2022] GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff => generated 1216 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:10.151465 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-f2c40d3e-c0db-49e9-a932-cd613221e66e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:10.153106 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-f2c40d3e-c0db-49e9-a932-cd613221e66e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:10.158438 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f2c40d3e-c0db-49e9-a932-cd613221e66e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:10.158872 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f2c40d3e-c0db-49e9-a932-cd613221e66e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:10.159307 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f2c40d3e-c0db-49e9-a932-cd613221e66e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:10.160050 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f2c40d3e-c0db-49e9-a932-cd613221e66e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:10.160504 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f2c40d3e-c0db-49e9-a932-cd613221e66e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:10.160925 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f2c40d3e-c0db-49e9-a932-cd613221e66e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:10.315642 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-f2c40d3e-c0db-49e9-a932-cd613221e66e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:10.329408 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-f2c40d3e-c0db-49e9-a932-cd613221e66e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91" status: 200 len: 1371 microversion: 2.1 time: 0.181532 Nov 02 14:42:10.330300 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 192/358] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:10 2022] GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 => generated 1371 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:10.368880 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-29a3bd28-15c5-414e-9623-6d851c2a3bfa tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:10.369857 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-29a3bd28-15c5-414e-9623-6d851c2a3bfa tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:10.377358 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-29a3bd28-15c5-414e-9623-6d851c2a3bfa tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:10.380421 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-29a3bd28-15c5-414e-9623-6d851c2a3bfa tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:10.382626 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-29a3bd28-15c5-414e-9623-6d851c2a3bfa tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:10.395546 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-29a3bd28-15c5-414e-9623-6d851c2a3bfa tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:10.395546 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-29a3bd28-15c5-414e-9623-6d851c2a3bfa tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:10.395546 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-29a3bd28-15c5-414e-9623-6d851c2a3bfa tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:10.572162 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-29a3bd28-15c5-414e-9623-6d851c2a3bfa tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cc06a6df04ca4ab453de57ee84279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60a52ce75b94198ac6abb7727e7072d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:10.583890 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-29a3bd28-15c5-414e-9623-6d851c2a3bfa tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7" status: 200 len: 1358 microversion: 2.1 time: 0.219004 Nov 02 14:42:10.586058 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 167/359] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:10 2022] GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7 => generated 1358 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:10.749565 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-fbe94052-a37a-44f8-abaa-92f656cb3ccd tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:10.750359 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-fbe94052-a37a-44f8-abaa-92f656cb3ccd tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:10.765613 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fbe94052-a37a-44f8-abaa-92f656cb3ccd tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:10.767391 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fbe94052-a37a-44f8-abaa-92f656cb3ccd tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:10.768097 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fbe94052-a37a-44f8-abaa-92f656cb3ccd tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:10.769066 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fbe94052-a37a-44f8-abaa-92f656cb3ccd tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:10.769729 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fbe94052-a37a-44f8-abaa-92f656cb3ccd tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:10.770349 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fbe94052-a37a-44f8-abaa-92f656cb3ccd tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:10.810975 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell1:SELECT=100 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:42:11.011305 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-fbe94052-a37a-44f8-abaa-92f656cb3ccd tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:11.024038 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-fbe94052-a37a-44f8-abaa-92f656cb3ccd tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:11.025992 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-fbe94052-a37a-44f8-abaa-92f656cb3ccd tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:11.027239 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-fbe94052-a37a-44f8-abaa-92f656cb3ccd tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1740 microversion: 2.20 time: 0.282683 Nov 02 14:42:11.028349 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 193/360] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:42:10 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1740 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:42:11.040042 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-18ab8774-dbf0-45f4-b788-3bb091804200 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:11.040683 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-18ab8774-dbf0-45f4-b788-3bb091804200 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: bd91069f-ef45-44b0-a9c8-022d089d2dff] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:11.062661 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-18ab8774-dbf0-45f4-b788-3bb091804200 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:11.063165 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-18ab8774-dbf0-45f4-b788-3bb091804200 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:11.065244 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-18ab8774-dbf0-45f4-b788-3bb091804200 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:11.067335 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-18ab8774-dbf0-45f4-b788-3bb091804200 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:11.068885 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-18ab8774-dbf0-45f4-b788-3bb091804200 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:11.069528 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-18ab8774-dbf0-45f4-b788-3bb091804200 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:11.179383 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-18ab8774-dbf0-45f4-b788-3bb091804200 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:11.192835 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-18ab8774-dbf0-45f4-b788-3bb091804200 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff" status: 200 len: 1264 microversion: 2.1 time: 0.157509 Nov 02 14:42:11.195228 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 168/361] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:11 2022] GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:42:11.355947 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-95bc4ae0-de3a-46a5-9722-e561ecb094ee tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:11.357442 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-95bc4ae0-de3a-46a5-9722-e561ecb094ee tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:11.364705 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-95bc4ae0-de3a-46a5-9722-e561ecb094ee tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:11.365636 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-95bc4ae0-de3a-46a5-9722-e561ecb094ee tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:11.366440 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-95bc4ae0-de3a-46a5-9722-e561ecb094ee tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:11.367503 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-95bc4ae0-de3a-46a5-9722-e561ecb094ee tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:11.367959 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-95bc4ae0-de3a-46a5-9722-e561ecb094ee tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:11.368385 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-95bc4ae0-de3a-46a5-9722-e561ecb094ee tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:11.531952 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-95bc4ae0-de3a-46a5-9722-e561ecb094ee tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:11.546744 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-95bc4ae0-de3a-46a5-9722-e561ecb094ee tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91" status: 200 len: 1565 microversion: 2.1 time: 0.194800 Nov 02 14:42:11.547336 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 194/362] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:11 2022] GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 => generated 1565 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:11.570268 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-c08cb558-7e01-49b2-a8bc-1f94baace7eb tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:11.570818 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-c08cb558-7e01-49b2-a8bc-1f94baace7eb tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:11.583537 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c08cb558-7e01-49b2-a8bc-1f94baace7eb tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:11.584024 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c08cb558-7e01-49b2-a8bc-1f94baace7eb tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:11.584457 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c08cb558-7e01-49b2-a8bc-1f94baace7eb tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:11.585239 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c08cb558-7e01-49b2-a8bc-1f94baace7eb tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:11.585685 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c08cb558-7e01-49b2-a8bc-1f94baace7eb tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:11.586104 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c08cb558-7e01-49b2-a8bc-1f94baace7eb tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:11.611528 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-aebdaf5f-0ed7-47c4-ab0e-8173e0c5c944 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:11.613930 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-aebdaf5f-0ed7-47c4-ab0e-8173e0c5c944 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:11.619968 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-aebdaf5f-0ed7-47c4-ab0e-8173e0c5c944 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:11.620456 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-aebdaf5f-0ed7-47c4-ab0e-8173e0c5c944 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:11.620886 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-aebdaf5f-0ed7-47c4-ab0e-8173e0c5c944 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:11.621638 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-aebdaf5f-0ed7-47c4-ab0e-8173e0c5c944 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:11.622284 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-aebdaf5f-0ed7-47c4-ab0e-8173e0c5c944 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:11.622718 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-aebdaf5f-0ed7-47c4-ab0e-8173e0c5c944 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:11.690946 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-c08cb558-7e01-49b2-a8bc-1f94baace7eb tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.124210 Nov 02 14:42:11.693286 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 169/363] 10.222.0.30 () {58 vars in 1275 bytes} [Wed Nov 2 14:42:11 2022] GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91/os-interface => generated 284 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:42:12.018988 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-aebdaf5f-0ed7-47c4-ab0e-8173e0c5c944 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cc06a6df04ca4ab453de57ee84279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60a52ce75b94198ac6abb7727e7072d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:12.027003 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-aebdaf5f-0ed7-47c4-ab0e-8173e0c5c944 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7" status: 200 len: 1358 microversion: 2.1 time: 0.420247 Nov 02 14:42:12.041861 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 195/364] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:11 2022] GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7 => generated 1358 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:12.057136 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-c7523fcd-dfa7-4daa-8b9b-a5fe5c1b4cbc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:12.059396 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-c7523fcd-dfa7-4daa-8b9b-a5fe5c1b4cbc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:12.067392 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c7523fcd-dfa7-4daa-8b9b-a5fe5c1b4cbc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:12.067950 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c7523fcd-dfa7-4daa-8b9b-a5fe5c1b4cbc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:12.068911 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c7523fcd-dfa7-4daa-8b9b-a5fe5c1b4cbc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:12.069758 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c7523fcd-dfa7-4daa-8b9b-a5fe5c1b4cbc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:12.070581 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c7523fcd-dfa7-4daa-8b9b-a5fe5c1b4cbc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:12.071061 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c7523fcd-dfa7-4daa-8b9b-a5fe5c1b4cbc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:12.219432 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-89ba0638-263a-40d2-9683-f4d0280d4d4c tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:12.220647 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-89ba0638-263a-40d2-9683-f4d0280d4d4c tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: bd91069f-ef45-44b0-a9c8-022d089d2dff] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:12.227117 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-89ba0638-263a-40d2-9683-f4d0280d4d4c tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:12.227598 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-89ba0638-263a-40d2-9683-f4d0280d4d4c tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:12.228035 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-89ba0638-263a-40d2-9683-f4d0280d4d4c tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:12.228806 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-89ba0638-263a-40d2-9683-f4d0280d4d4c tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:12.229591 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-89ba0638-263a-40d2-9683-f4d0280d4d4c tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:12.229725 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-89ba0638-263a-40d2-9683-f4d0280d4d4c tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:12.451399 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-89ba0638-263a-40d2-9683-f4d0280d4d4c tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:12.467186 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-89ba0638-263a-40d2-9683-f4d0280d4d4c tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff" status: 200 len: 1272 microversion: 2.1 time: 0.251908 Nov 02 14:42:12.467186 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 196/365] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:12 2022] GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff => generated 1272 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:12.713553 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-c7523fcd-dfa7-4daa-8b9b-a5fe5c1b4cbc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:12.723280 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-c7523fcd-dfa7-4daa-8b9b-a5fe5c1b4cbc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:12.724731 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-c7523fcd-dfa7-4daa-8b9b-a5fe5c1b4cbc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:12.725957 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-c7523fcd-dfa7-4daa-8b9b-a5fe5c1b4cbc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1740 microversion: 2.20 time: 0.675409 Nov 02 14:42:12.726518 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 170/366] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:42:12 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1740 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:42:12.925742 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [req-af23ffae-7686-4be8-8203-871173c5ba6b req-e5be3c66-7f9f-449d-8bad-27b52b960d46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24d10c5a-012e-4d8a-8188-c2289e1605b7", "name": "network-vif-plugged", "status": "completed", "tag": "881c5e7e-3ed6-4eda-ba12-f2fc35e98f97"}]} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:42:12.942455 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-af23ffae-7686-4be8-8203-871173c5ba6b req-e5be3c66-7f9f-449d-8bad-27b52b960d46 service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:12.942755 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-af23ffae-7686-4be8-8203-871173c5ba6b req-e5be3c66-7f9f-449d-8bad-27b52b960d46 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:12.943922 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-af23ffae-7686-4be8-8203-871173c5ba6b req-e5be3c66-7f9f-449d-8bad-27b52b960d46 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:12.961178 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.compute.server_external_events [req-af23ffae-7686-4be8-8203-871173c5ba6b req-e5be3c66-7f9f-449d-8bad-27b52b960d46 service nova] Creating event network-vif-plugged:881c5e7e-3ed6-4eda-ba12-f2fc35e98f97 for instance 24d10c5a-012e-4d8a-8188-c2289e1605b7 on hv-cinder-86236 Nov 02 14:42:12.969043 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [req-af23ffae-7686-4be8-8203-871173c5ba6b req-e5be3c66-7f9f-449d-8bad-27b52b960d46 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049369 Nov 02 14:42:12.971040 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 197/367] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:42:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:42:13.052651 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-2a60d2b2-9ea9-4e1d-bc77-161203e6987f tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:13.053521 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-2a60d2b2-9ea9-4e1d-bc77-161203e6987f tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:13.060573 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2a60d2b2-9ea9-4e1d-bc77-161203e6987f tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:13.062668 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2a60d2b2-9ea9-4e1d-bc77-161203e6987f tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:13.064739 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2a60d2b2-9ea9-4e1d-bc77-161203e6987f tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:13.065797 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2a60d2b2-9ea9-4e1d-bc77-161203e6987f tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:13.066472 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2a60d2b2-9ea9-4e1d-bc77-161203e6987f tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:13.069358 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2a60d2b2-9ea9-4e1d-bc77-161203e6987f tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:13.495105 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-b3d6b283-c84a-49eb-8727-ada3ea9fe407 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:13.495958 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-b3d6b283-c84a-49eb-8727-ada3ea9fe407 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: bd91069f-ef45-44b0-a9c8-022d089d2dff] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:13.504800 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b3d6b283-c84a-49eb-8727-ada3ea9fe407 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:13.505333 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b3d6b283-c84a-49eb-8727-ada3ea9fe407 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:13.505770 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b3d6b283-c84a-49eb-8727-ada3ea9fe407 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:13.506478 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b3d6b283-c84a-49eb-8727-ada3ea9fe407 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:13.507019 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b3d6b283-c84a-49eb-8727-ada3ea9fe407 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:13.507352 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b3d6b283-c84a-49eb-8727-ada3ea9fe407 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:13.563276 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-2a60d2b2-9ea9-4e1d-bc77-161203e6987f tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cc06a6df04ca4ab453de57ee84279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60a52ce75b94198ac6abb7727e7072d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:13.584284 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-2a60d2b2-9ea9-4e1d-bc77-161203e6987f tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7" status: 200 len: 1358 microversion: 2.1 time: 0.535707 Nov 02 14:42:13.585505 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 171/368] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:13 2022] GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7 => generated 1358 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:13.686407 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-b3d6b283-c84a-49eb-8727-ada3ea9fe407 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:13.699854 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-b3d6b283-c84a-49eb-8727-ada3ea9fe407 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff" status: 200 len: 1270 microversion: 2.1 time: 0.208954 Nov 02 14:42:13.717282 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 198/369] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:13 2022] GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff => generated 1270 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:13.754222 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-524e3ca4-5339-4489-8728-b8e7f884fb91 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:13.755918 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-524e3ca4-5339-4489-8728-b8e7f884fb91 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:13.764041 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-524e3ca4-5339-4489-8728-b8e7f884fb91 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:13.764531 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-524e3ca4-5339-4489-8728-b8e7f884fb91 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:13.764971 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-524e3ca4-5339-4489-8728-b8e7f884fb91 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:13.765720 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-524e3ca4-5339-4489-8728-b8e7f884fb91 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:13.766167 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-524e3ca4-5339-4489-8728-b8e7f884fb91 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:13.766647 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-524e3ca4-5339-4489-8728-b8e7f884fb91 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:14.352243 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-524e3ca4-5339-4489-8728-b8e7f884fb91 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:14.360812 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-524e3ca4-5339-4489-8728-b8e7f884fb91 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:14.362303 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-524e3ca4-5339-4489-8728-b8e7f884fb91 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:14.363481 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-524e3ca4-5339-4489-8728-b8e7f884fb91 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1722 microversion: 2.20 time: 0.615185 Nov 02 14:42:14.364047 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 172/370] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:42:13 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1722 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:42:14.615544 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [req-3cfa9a73-788b-453f-9ef5-5c834173b535 req-52eb9a8c-4c31-42bd-8762-b6eb5a6d8548 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d1d6b9a-4ef9-47db-b416-7a0a0f885d91", "tag": "fc1bebad-c267-4384-b8ba-b3d4c19799bd"}]} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:42:14.616162 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-abd560dd-9715-4a8d-ad42-53354626a7ae tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:14.616162 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-abd560dd-9715-4a8d-ad42-53354626a7ae tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:14.619214 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-abd560dd-9715-4a8d-ad42-53354626a7ae tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:14.620220 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-abd560dd-9715-4a8d-ad42-53354626a7ae tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:14.620862 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-abd560dd-9715-4a8d-ad42-53354626a7ae tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:14.622223 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-abd560dd-9715-4a8d-ad42-53354626a7ae tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:14.622549 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-3cfa9a73-788b-453f-9ef5-5c834173b535 req-52eb9a8c-4c31-42bd-8762-b6eb5a6d8548 service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:14.623048 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-3cfa9a73-788b-453f-9ef5-5c834173b535 req-52eb9a8c-4c31-42bd-8762-b6eb5a6d8548 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:14.623486 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-3cfa9a73-788b-453f-9ef5-5c834173b535 req-52eb9a8c-4c31-42bd-8762-b6eb5a6d8548 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:14.623851 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-abd560dd-9715-4a8d-ad42-53354626a7ae tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:14.624656 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-abd560dd-9715-4a8d-ad42-53354626a7ae tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:14.639846 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.compute.server_external_events [req-3cfa9a73-788b-453f-9ef5-5c834173b535 req-52eb9a8c-4c31-42bd-8762-b6eb5a6d8548 service nova] Creating event network-changed:fc1bebad-c267-4384-b8ba-b3d4c19799bd for instance 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 on hv-cinder-86236 Nov 02 14:42:14.644977 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [req-3cfa9a73-788b-453f-9ef5-5c834173b535 req-52eb9a8c-4c31-42bd-8762-b6eb5a6d8548 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040868 Nov 02 14:42:14.649583 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 199/371] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:42:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:42:14.729804 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-ed8877e0-0407-4c6c-bad8-6100b19c7959 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:14.730887 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-ed8877e0-0407-4c6c-bad8-6100b19c7959 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: bd91069f-ef45-44b0-a9c8-022d089d2dff] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:14.738064 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ed8877e0-0407-4c6c-bad8-6100b19c7959 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:14.741515 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ed8877e0-0407-4c6c-bad8-6100b19c7959 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:14.741515 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ed8877e0-0407-4c6c-bad8-6100b19c7959 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:14.741515 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ed8877e0-0407-4c6c-bad8-6100b19c7959 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:14.741515 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ed8877e0-0407-4c6c-bad8-6100b19c7959 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:14.741844 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ed8877e0-0407-4c6c-bad8-6100b19c7959 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:14.777087 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-abd560dd-9715-4a8d-ad42-53354626a7ae tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cc06a6df04ca4ab453de57ee84279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60a52ce75b94198ac6abb7727e7072d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:14.786977 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-abd560dd-9715-4a8d-ad42-53354626a7ae tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7" status: 200 len: 1358 microversion: 2.1 time: 0.181297 Nov 02 14:42:14.794854 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 173/372] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:14 2022] GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:14.884508 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-ed8877e0-0407-4c6c-bad8-6100b19c7959 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:14.900004 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-ed8877e0-0407-4c6c-bad8-6100b19c7959 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff" status: 200 len: 1312 microversion: 2.1 time: 0.174670 Nov 02 14:42:14.900834 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 200/373] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:14 2022] GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff => generated 1312 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:42:15.006916 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [req-dc62f4b4-ccba-4d1f-839d-ce2df4404d68 req-c8db9066-f6d4-46b8-b38a-f385d2350919 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d0f8129-8155-4b7c-a462-f9c067ecfbca", "name": "network-vif-unplugged", "status": "completed", "tag": "af3cc54b-a081-4f0c-aad1-a5c16e7530c7"}]} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:42:15.016405 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-dc62f4b4-ccba-4d1f-839d-ce2df4404d68 req-c8db9066-f6d4-46b8-b38a-f385d2350919 service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:15.018433 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-dc62f4b4-ccba-4d1f-839d-ce2df4404d68 req-c8db9066-f6d4-46b8-b38a-f385d2350919 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:15.018433 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-dc62f4b4-ccba-4d1f-839d-ce2df4404d68 req-c8db9066-f6d4-46b8-b38a-f385d2350919 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:15.030075 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.compute.server_external_events [req-dc62f4b4-ccba-4d1f-839d-ce2df4404d68 req-c8db9066-f6d4-46b8-b38a-f385d2350919 service nova] Creating event network-vif-unplugged:af3cc54b-a081-4f0c-aad1-a5c16e7530c7 for instance 5d0f8129-8155-4b7c-a462-f9c067ecfbca on hv-cinder-86236 Nov 02 14:42:15.036963 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [req-dc62f4b4-ccba-4d1f-839d-ce2df4404d68 req-c8db9066-f6d4-46b8-b38a-f385d2350919 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032969 Nov 02 14:42:15.037183 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 174/374] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:42:15.389148 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-2a83ebf6-4f71-43d3-9898-5d21f47ebabb tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:15.392193 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-2a83ebf6-4f71-43d3-9898-5d21f47ebabb tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:15.404216 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2a83ebf6-4f71-43d3-9898-5d21f47ebabb tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:15.404709 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2a83ebf6-4f71-43d3-9898-5d21f47ebabb tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:15.405180 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2a83ebf6-4f71-43d3-9898-5d21f47ebabb tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:15.405885 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2a83ebf6-4f71-43d3-9898-5d21f47ebabb tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:15.406335 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2a83ebf6-4f71-43d3-9898-5d21f47ebabb tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:15.406757 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2a83ebf6-4f71-43d3-9898-5d21f47ebabb tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:15.558578 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-2a83ebf6-4f71-43d3-9898-5d21f47ebabb tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:15.567396 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-2a83ebf6-4f71-43d3-9898-5d21f47ebabb tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:15.569121 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-2a83ebf6-4f71-43d3-9898-5d21f47ebabb tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:15.570335 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-2a83ebf6-4f71-43d3-9898-5d21f47ebabb tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1722 microversion: 2.20 time: 0.185209 Nov 02 14:42:15.573041 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 201/375] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:42:15 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:42:15.813526 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-9cd2756b-6430-4acb-88f5-079fd19b375c tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:15.815448 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-9cd2756b-6430-4acb-88f5-079fd19b375c tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:15.823521 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9cd2756b-6430-4acb-88f5-079fd19b375c tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:15.824083 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9cd2756b-6430-4acb-88f5-079fd19b375c tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:15.824626 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9cd2756b-6430-4acb-88f5-079fd19b375c tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:15.825582 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9cd2756b-6430-4acb-88f5-079fd19b375c tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:15.831911 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9cd2756b-6430-4acb-88f5-079fd19b375c tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:15.831911 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9cd2756b-6430-4acb-88f5-079fd19b375c tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:15.929024 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-1266813c-98dc-431c-af63-3992122eacb2 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:15.929757 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-1266813c-98dc-431c-af63-3992122eacb2 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: bd91069f-ef45-44b0-a9c8-022d089d2dff] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:15.941874 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1266813c-98dc-431c-af63-3992122eacb2 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:15.942737 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1266813c-98dc-431c-af63-3992122eacb2 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:15.943183 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1266813c-98dc-431c-af63-3992122eacb2 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:15.943899 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1266813c-98dc-431c-af63-3992122eacb2 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:15.944356 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1266813c-98dc-431c-af63-3992122eacb2 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:15.944789 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1266813c-98dc-431c-af63-3992122eacb2 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:16.125266 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-9cd2756b-6430-4acb-88f5-079fd19b375c tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cc06a6df04ca4ab453de57ee84279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60a52ce75b94198ac6abb7727e7072d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:16.134003 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-9cd2756b-6430-4acb-88f5-079fd19b375c tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7" status: 200 len: 1358 microversion: 2.1 time: 0.326755 Nov 02 14:42:16.134587 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 175/376] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:15 2022] GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7 => generated 1358 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:16.140261 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-47f0ed1a-0444-41ba-8ca1-bc7c543a22ea tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-852913904", "imageRef": "a726a246-cc7f-46e6-aeff-4d62e03cc091", "flavorRef": "452"}} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:42:16.194754 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.network.neutron [None req-47f0ed1a-0444-41ba-8ca1-bc7c543a22ea tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] validate_networks() for None {{(pid=119658) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:42:16.271421 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-1266813c-98dc-431c-af63-3992122eacb2 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:16.281597 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-1266813c-98dc-431c-af63-3992122eacb2 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff" status: 200 len: 1312 microversion: 2.1 time: 0.359104 Nov 02 14:42:16.283482 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 202/377] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:15 2022] GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff => generated 1312 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:16.596790 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-034eb08d-d03c-4d76-a5d3-07dbb72917d6 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:16.597824 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-034eb08d-d03c-4d76-a5d3-07dbb72917d6 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:16.600313 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-47f0ed1a-0444-41ba-8ca1-bc7c543a22ea tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Flavor limits 0:0:0 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:42:16.600730 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-47f0ed1a-0444-41ba-8ca1-bc7c543a22ea tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Image limits 0:0:0 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:42:16.601274 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-47f0ed1a-0444-41ba-8ca1-bc7c543a22ea tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Flavor pref 0:0:0 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:42:16.601682 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-47f0ed1a-0444-41ba-8ca1-bc7c543a22ea tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Image pref 0:0:0 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:42:16.602084 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-47f0ed1a-0444-41ba-8ca1-bc7c543a22ea tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:42:16.604002 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-034eb08d-d03c-4d76-a5d3-07dbb72917d6 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:16.604491 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-034eb08d-d03c-4d76-a5d3-07dbb72917d6 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:16.604928 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-034eb08d-d03c-4d76-a5d3-07dbb72917d6 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:16.605663 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-034eb08d-d03c-4d76-a5d3-07dbb72917d6 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:16.606117 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-034eb08d-d03c-4d76-a5d3-07dbb72917d6 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:16.606569 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-034eb08d-d03c-4d76-a5d3-07dbb72917d6 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:16.611841 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-47f0ed1a-0444-41ba-8ca1-bc7c543a22ea tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:16.612188 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-47f0ed1a-0444-41ba-8ca1-bc7c543a22ea tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:16.612618 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-47f0ed1a-0444-41ba-8ca1-bc7c543a22ea tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:16.613362 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-47f0ed1a-0444-41ba-8ca1-bc7c543a22ea tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:16.613809 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-47f0ed1a-0444-41ba-8ca1-bc7c543a22ea tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:16.614224 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-47f0ed1a-0444-41ba-8ca1-bc7c543a22ea tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:16.631843 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.quota [None req-47f0ed1a-0444-41ba-8ca1-bc7c543a22ea tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Getting quotas for project f8e090451c7e4296a0b85c7eeb9002f7. Resources: {'instances', 'ram', 'cores'} {{(pid=119658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:42:16.635922 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.quota [None req-47f0ed1a-0444-41ba-8ca1-bc7c543a22ea tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Getting quotas for user 2fa6a7aba33d4abd9389ecd2e3fa0906 and project f8e090451c7e4296a0b85c7eeb9002f7. Resources: {'instances', 'ram', 'cores'} {{(pid=119658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:42:16.649659 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-47f0ed1a-0444-41ba-8ca1-bc7c543a22ea tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Going to run 1 instances... {{(pid=119658) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:42:16.652400 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-47f0ed1a-0444-41ba-8ca1-bc7c543a22ea tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] [instance: 42424cc7-8d64-4aac-8fb8-405b40f5b526] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a726a246-cc7f-46e6-aeff-4d62e03cc091',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119658) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:42:16.772674 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-47f0ed1a-0444-41ba-8ca1-bc7c543a22ea tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.636283 Nov 02 14:42:16.773521 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 176/378] 10.222.0.30 () {60 vars in 1147 bytes} [Wed Nov 2 14:42:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:42:16.785283 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-89012c0f-4643-4b93-b65c-add958b177c8 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:16.785894 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-89012c0f-4643-4b93-b65c-add958b177c8 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] [instance: 42424cc7-8d64-4aac-8fb8-405b40f5b526] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:16.848704 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-034eb08d-d03c-4d76-a5d3-07dbb72917d6 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:16.859703 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-034eb08d-d03c-4d76-a5d3-07dbb72917d6 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:16.863339 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-034eb08d-d03c-4d76-a5d3-07dbb72917d6 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:16.864572 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-034eb08d-d03c-4d76-a5d3-07dbb72917d6 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1722 microversion: 2.20 time: 0.272607 Nov 02 14:42:16.865640 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 203/379] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:42:16 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1722 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:42:16.871762 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-89012c0f-4643-4b93-b65c-add958b177c8 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa6a7aba33d4abd9389ecd2e3fa0906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e090451c7e4296a0b85c7eeb9002f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:16.882771 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-89012c0f-4643-4b93-b65c-add958b177c8 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] 10.222.0.30 "GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526" status: 200 len: 1214 microversion: 2.1 time: 0.102262 Nov 02 14:42:16.884608 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 177/380] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:16 2022] GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526 => generated 1214 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:42:17.154302 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [req-d59e4951-d060-48c5-bda6-5c28d208ef39 req-3728220c-3081-4bf8-9f71-d39d3afdb3d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd91069f-ef45-44b0-a9c8-022d089d2dff", "tag": "bdeedfb0-c94b-4193-9d25-ca0bb97dc80d"}]} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:42:17.160519 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-ec767a5a-ea6e-4228-a2bd-b01ddaca23ba tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:17.164747 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-ec767a5a-ea6e-4228-a2bd-b01ddaca23ba tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:17.172375 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ec767a5a-ea6e-4228-a2bd-b01ddaca23ba tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:17.178365 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ec767a5a-ea6e-4228-a2bd-b01ddaca23ba tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:17.179224 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ec767a5a-ea6e-4228-a2bd-b01ddaca23ba tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:17.180246 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ec767a5a-ea6e-4228-a2bd-b01ddaca23ba tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:17.181305 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-d59e4951-d060-48c5-bda6-5c28d208ef39 req-3728220c-3081-4bf8-9f71-d39d3afdb3d6 service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:17.181775 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-d59e4951-d060-48c5-bda6-5c28d208ef39 req-3728220c-3081-4bf8-9f71-d39d3afdb3d6 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:17.182202 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-d59e4951-d060-48c5-bda6-5c28d208ef39 req-3728220c-3081-4bf8-9f71-d39d3afdb3d6 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:17.186714 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ec767a5a-ea6e-4228-a2bd-b01ddaca23ba tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:17.187154 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ec767a5a-ea6e-4228-a2bd-b01ddaca23ba tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:17.199778 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.compute.server_external_events [req-d59e4951-d060-48c5-bda6-5c28d208ef39 req-3728220c-3081-4bf8-9f71-d39d3afdb3d6 service nova] Creating event network-changed:bdeedfb0-c94b-4193-9d25-ca0bb97dc80d for instance bd91069f-ef45-44b0-a9c8-022d089d2dff on hv-cinder-86236 Nov 02 14:42:17.205511 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [req-d59e4951-d060-48c5-bda6-5c28d208ef39 req-3728220c-3081-4bf8-9f71-d39d3afdb3d6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054777 Nov 02 14:42:17.207177 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 204/381] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:42:17.307663 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-6de9024d-b95a-449e-b516-4c02ff2d8408 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:17.308359 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-6de9024d-b95a-449e-b516-4c02ff2d8408 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: bd91069f-ef45-44b0-a9c8-022d089d2dff] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:17.315406 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6de9024d-b95a-449e-b516-4c02ff2d8408 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:17.315884 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6de9024d-b95a-449e-b516-4c02ff2d8408 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:17.316995 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6de9024d-b95a-449e-b516-4c02ff2d8408 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:17.317236 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6de9024d-b95a-449e-b516-4c02ff2d8408 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:17.317683 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6de9024d-b95a-449e-b516-4c02ff2d8408 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:17.318107 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6de9024d-b95a-449e-b516-4c02ff2d8408 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:17.442444 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-ec767a5a-ea6e-4228-a2bd-b01ddaca23ba tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cc06a6df04ca4ab453de57ee84279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60a52ce75b94198ac6abb7727e7072d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:17.463501 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-ec767a5a-ea6e-4228-a2bd-b01ddaca23ba tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7" status: 200 len: 1358 microversion: 2.1 time: 0.307415 Nov 02 14:42:17.465905 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 178/382] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:17 2022] GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7 => generated 1358 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:17.643385 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-6de9024d-b95a-449e-b516-4c02ff2d8408 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:17.651467 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-6de9024d-b95a-449e-b516-4c02ff2d8408 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff" status: 200 len: 1312 microversion: 2.1 time: 0.349017 Nov 02 14:42:17.652058 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 205/383] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:17 2022] GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff => generated 1312 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:17.894545 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-5acab220-6bfa-46bc-8899-09fbefbda33e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:17.895727 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-5acab220-6bfa-46bc-8899-09fbefbda33e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:17.916126 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-66baf5a6-d8e0-41f9-ae33-22b466ab7393 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:17.918933 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-66baf5a6-d8e0-41f9-ae33-22b466ab7393 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] [instance: 42424cc7-8d64-4aac-8fb8-405b40f5b526] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:17.926363 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5acab220-6bfa-46bc-8899-09fbefbda33e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:17.930206 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5acab220-6bfa-46bc-8899-09fbefbda33e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:17.930690 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5acab220-6bfa-46bc-8899-09fbefbda33e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:17.931499 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5acab220-6bfa-46bc-8899-09fbefbda33e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:17.931958 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5acab220-6bfa-46bc-8899-09fbefbda33e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:17.932383 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5acab220-6bfa-46bc-8899-09fbefbda33e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:18.027443 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-66baf5a6-d8e0-41f9-ae33-22b466ab7393 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa6a7aba33d4abd9389ecd2e3fa0906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e090451c7e4296a0b85c7eeb9002f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:18.039567 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-66baf5a6-d8e0-41f9-ae33-22b466ab7393 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] 10.222.0.30 "GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526" status: 200 len: 1214 microversion: 2.1 time: 0.128399 Nov 02 14:42:18.042300 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 206/384] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:17 2022] GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526 => generated 1214 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:18.129275 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-5acab220-6bfa-46bc-8899-09fbefbda33e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:18.138998 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-5acab220-6bfa-46bc-8899-09fbefbda33e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:18.141538 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-5acab220-6bfa-46bc-8899-09fbefbda33e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:18.144911 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-5acab220-6bfa-46bc-8899-09fbefbda33e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1725 microversion: 2.20 time: 0.254300 Nov 02 14:42:18.144911 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 179/385] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:42:17 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1725 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:42:18.170020 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-2983bcd2-a0c3-4508-b60c-c1b9698f48be tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "af93c542-4ca2-49c5-8c7b-7e5f18f9b83e"}} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:42:18.172565 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-2983bcd2-a0c3-4508-b60c-c1b9698f48be tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:18.183060 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2983bcd2-a0c3-4508-b60c-c1b9698f48be tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:18.183886 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2983bcd2-a0c3-4508-b60c-c1b9698f48be tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:18.184393 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2983bcd2-a0c3-4508-b60c-c1b9698f48be tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:18.185728 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2983bcd2-a0c3-4508-b60c-c1b9698f48be tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:18.186640 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2983bcd2-a0c3-4508-b60c-c1b9698f48be tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:18.187318 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2983bcd2-a0c3-4508-b60c-c1b9698f48be tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:18.494217 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-17fc7e59-0660-4ce9-b412-24ab106c1cd5 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:18.494829 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-17fc7e59-0660-4ce9-b412-24ab106c1cd5 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:18.501561 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-17fc7e59-0660-4ce9-b412-24ab106c1cd5 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:18.502042 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-17fc7e59-0660-4ce9-b412-24ab106c1cd5 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:18.502477 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-17fc7e59-0660-4ce9-b412-24ab106c1cd5 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:18.503179 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-17fc7e59-0660-4ce9-b412-24ab106c1cd5 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:18.505436 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-17fc7e59-0660-4ce9-b412-24ab106c1cd5 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:18.506110 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-17fc7e59-0660-4ce9-b412-24ab106c1cd5 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:18.686672 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-17fc7e59-0660-4ce9-b412-24ab106c1cd5 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cc06a6df04ca4ab453de57ee84279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60a52ce75b94198ac6abb7727e7072d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:18.694842 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-17fc7e59-0660-4ce9-b412-24ab106c1cd5 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7" status: 200 len: 1548 microversion: 2.1 time: 0.204588 Nov 02 14:42:18.695436 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 180/386] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:18 2022] GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7 => generated 1548 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:42:18.700582 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-dba286b0-9e0e-44d3-8e8c-7004b9c57169 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:18.701239 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-dba286b0-9e0e-44d3-8e8c-7004b9c57169 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: bd91069f-ef45-44b0-a9c8-022d089d2dff] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:18.723936 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-dba286b0-9e0e-44d3-8e8c-7004b9c57169 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:18.724533 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-dba286b0-9e0e-44d3-8e8c-7004b9c57169 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:18.725142 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-dba286b0-9e0e-44d3-8e8c-7004b9c57169 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:18.725931 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-dba286b0-9e0e-44d3-8e8c-7004b9c57169 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:18.726635 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-dba286b0-9e0e-44d3-8e8c-7004b9c57169 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:18.727312 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-dba286b0-9e0e-44d3-8e8c-7004b9c57169 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:18.873891 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-dba286b0-9e0e-44d3-8e8c-7004b9c57169 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:18.882924 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-dba286b0-9e0e-44d3-8e8c-7004b9c57169 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff" status: 200 len: 1312 microversion: 2.1 time: 0.186422 Nov 02 14:42:18.883514 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 181/387] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:18 2022] GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff => generated 1312 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:18.888777 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-4bd8d3b0-4cce-4cd7-8e12-5ff74200cb94 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:18.889438 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-4bd8d3b0-4cce-4cd7-8e12-5ff74200cb94 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:18.904822 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4bd8d3b0-4cce-4cd7-8e12-5ff74200cb94 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:18.906214 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4bd8d3b0-4cce-4cd7-8e12-5ff74200cb94 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:18.906931 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4bd8d3b0-4cce-4cd7-8e12-5ff74200cb94 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:18.908856 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4bd8d3b0-4cce-4cd7-8e12-5ff74200cb94 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:18.908856 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4bd8d3b0-4cce-4cd7-8e12-5ff74200cb94 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:18.909942 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4bd8d3b0-4cce-4cd7-8e12-5ff74200cb94 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:19.057304 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-4bd8d3b0-4cce-4cd7-8e12-5ff74200cb94 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cc06a6df04ca4ab453de57ee84279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60a52ce75b94198ac6abb7727e7072d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:19.062877 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell1:SELECT=100 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:42:19.068150 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-4bd8d3b0-4cce-4cd7-8e12-5ff74200cb94 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7" status: 200 len: 1548 microversion: 2.1 time: 0.183650 Nov 02 14:42:19.068719 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 182/388] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:18 2022] GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7 => generated 1548 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:19.073408 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-4ae9ab34-6dad-4b16-9d8c-4b668f52c154 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:19.074012 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-4ae9ab34-6dad-4b16-9d8c-4b668f52c154 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] [instance: 42424cc7-8d64-4aac-8fb8-405b40f5b526] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:19.080019 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4ae9ab34-6dad-4b16-9d8c-4b668f52c154 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:19.080526 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4ae9ab34-6dad-4b16-9d8c-4b668f52c154 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:19.080956 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4ae9ab34-6dad-4b16-9d8c-4b668f52c154 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:19.081761 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4ae9ab34-6dad-4b16-9d8c-4b668f52c154 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:19.082645 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4ae9ab34-6dad-4b16-9d8c-4b668f52c154 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:19.083142 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4ae9ab34-6dad-4b16-9d8c-4b668f52c154 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:19.149781 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-4ae9ab34-6dad-4b16-9d8c-4b668f52c154 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa6a7aba33d4abd9389ecd2e3fa0906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e090451c7e4296a0b85c7eeb9002f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:19.157878 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-4ae9ab34-6dad-4b16-9d8c-4b668f52c154 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] 10.222.0.30 "GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526" status: 200 len: 1266 microversion: 2.1 time: 0.087464 Nov 02 14:42:19.158451 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 183/389] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:19 2022] GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526 => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:19.162877 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-c6ecd737-854e-4494-93ff-81160224a511 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:19.167712 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-c6ecd737-854e-4494-93ff-81160224a511 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '277cc06a6df04ca4ab453de57ee84279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60a52ce75b94198ac6abb7727e7072d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:19.173641 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-c6ecd737-854e-4494-93ff-81160224a511 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Searching by: {'deleted': False, 'project_id': 'e60a52ce75b94198ac6abb7727e7072d'} {{(pid=119658) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 14:42:19.176801 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c6ecd737-854e-4494-93ff-81160224a511 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:19.177306 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c6ecd737-854e-4494-93ff-81160224a511 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:19.177733 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c6ecd737-854e-4494-93ff-81160224a511 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:19.178445 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c6ecd737-854e-4494-93ff-81160224a511 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:19.178893 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c6ecd737-854e-4494-93ff-81160224a511 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:19.179305 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c6ecd737-854e-4494-93ff-81160224a511 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:19.272172 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.multi_cell_list [None req-c6ecd737-854e-4494-93ff-81160224a511 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119658) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 14:42:19.370936 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-c6ecd737-854e-4494-93ff-81160224a511 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.211425 Nov 02 14:42:19.371529 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 184/390] 10.222.0.30 () {58 vars in 1125 bytes} [Wed Nov 2 14:42:19 2022] GET /compute/v2.1/servers => generated 343 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:42:19.383592 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-925c5f52-3c56-4836-aa3a-53ae38f46f81 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:19.384193 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-925c5f52-3c56-4836-aa3a-53ae38f46f81 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:19.390562 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-925c5f52-3c56-4836-aa3a-53ae38f46f81 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:19.391049 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-925c5f52-3c56-4836-aa3a-53ae38f46f81 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:19.391522 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-925c5f52-3c56-4836-aa3a-53ae38f46f81 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:19.392379 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-925c5f52-3c56-4836-aa3a-53ae38f46f81 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:19.392829 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-925c5f52-3c56-4836-aa3a-53ae38f46f81 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:19.393282 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-925c5f52-3c56-4836-aa3a-53ae38f46f81 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:19.421469 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-2983bcd2-a0c3-4508-b60c-c1b9698f48be tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "POST /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.255658 Nov 02 14:42:19.422174 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 207/391] 10.222.0.30 () {62 vars in 1364 bytes} [Wed Nov 2 14:42:18 2022] POST /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca/os-volume_attachments => generated 188 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 14:42:19.552078 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-925c5f52-3c56-4836-aa3a-53ae38f46f81 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cc06a6df04ca4ab453de57ee84279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60a52ce75b94198ac6abb7727e7072d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:19.560119 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-925c5f52-3c56-4836-aa3a-53ae38f46f81 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7" status: 200 len: 1548 microversion: 2.1 time: 0.180162 Nov 02 14:42:19.573097 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 185/392] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:19 2022] GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7 => generated 1548 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:42:19.591904 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-7bd9c317-f546-4744-9f22-3366da8b7007 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:42:19.592504 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-7bd9c317-f546-4744-9f22-3366da8b7007 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:19.600468 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7bd9c317-f546-4744-9f22-3366da8b7007 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:19.600971 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7bd9c317-f546-4744-9f22-3366da8b7007 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:19.601461 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7bd9c317-f546-4744-9f22-3366da8b7007 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:19.602174 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7bd9c317-f546-4744-9f22-3366da8b7007 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:19.602632 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7bd9c317-f546-4744-9f22-3366da8b7007 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:19.605964 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7bd9c317-f546-4744-9f22-3366da8b7007 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:19.651859 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-7bd9c317-f546-4744-9f22-3366da8b7007 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119659) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Nov 02 14:42:19.921224 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-b7c9ff89-3423-40ef-918e-7e40e0f3469c tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:19.921844 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-b7c9ff89-3423-40ef-918e-7e40e0f3469c tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: bd91069f-ef45-44b0-a9c8-022d089d2dff] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:19.928297 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b7c9ff89-3423-40ef-918e-7e40e0f3469c tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:19.928789 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b7c9ff89-3423-40ef-918e-7e40e0f3469c tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:19.929254 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b7c9ff89-3423-40ef-918e-7e40e0f3469c tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:19.929983 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b7c9ff89-3423-40ef-918e-7e40e0f3469c tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:19.930421 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b7c9ff89-3423-40ef-918e-7e40e0f3469c tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:19.930845 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b7c9ff89-3423-40ef-918e-7e40e0f3469c tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:20.021795 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-7bd9c317-f546-4744-9f22-3366da8b7007 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "POST /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca/action" status: 202 len: 0 microversion: 2.20 time: 0.434100 Nov 02 14:42:20.022719 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 208/393] 10.222.0.30 () {62 vars in 1319 bytes} [Wed Nov 2 14:42:19 2022] POST /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca/action => generated 0 bytes in 436 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:42:20.032246 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-6ca63803-94e7-4f44-8223-dfbb577a15a5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:20.034012 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-6ca63803-94e7-4f44-8223-dfbb577a15a5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:20.040763 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6ca63803-94e7-4f44-8223-dfbb577a15a5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:20.041629 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6ca63803-94e7-4f44-8223-dfbb577a15a5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:20.042361 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6ca63803-94e7-4f44-8223-dfbb577a15a5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:20.043363 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6ca63803-94e7-4f44-8223-dfbb577a15a5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:20.044001 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6ca63803-94e7-4f44-8223-dfbb577a15a5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:20.044715 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6ca63803-94e7-4f44-8223-dfbb577a15a5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:20.066628 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:42:20.095151 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-b7c9ff89-3423-40ef-918e-7e40e0f3469c tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:20.104644 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-b7c9ff89-3423-40ef-918e-7e40e0f3469c tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff" status: 200 len: 1312 microversion: 2.1 time: 0.187328 Nov 02 14:42:20.124918 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 186/394] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:19 2022] GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff => generated 1312 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:20.182283 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-3ba02855-9071-43cc-89fb-a1870e8cc9a0 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:20.182907 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-3ba02855-9071-43cc-89fb-a1870e8cc9a0 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] [instance: 42424cc7-8d64-4aac-8fb8-405b40f5b526] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:20.191302 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3ba02855-9071-43cc-89fb-a1870e8cc9a0 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:20.191799 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3ba02855-9071-43cc-89fb-a1870e8cc9a0 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:20.221540 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3ba02855-9071-43cc-89fb-a1870e8cc9a0 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:20.221540 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3ba02855-9071-43cc-89fb-a1870e8cc9a0 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:20.221540 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3ba02855-9071-43cc-89fb-a1870e8cc9a0 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:20.221540 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3ba02855-9071-43cc-89fb-a1870e8cc9a0 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:20.277131 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-6ca63803-94e7-4f44-8223-dfbb577a15a5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:20.294339 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-6ca63803-94e7-4f44-8223-dfbb577a15a5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:20.295962 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-6ca63803-94e7-4f44-8223-dfbb577a15a5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:20.297151 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-6ca63803-94e7-4f44-8223-dfbb577a15a5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1751 microversion: 2.20 time: 0.269880 Nov 02 14:42:20.297701 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 209/395] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:42:20 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1751 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:42:20.339574 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-3ba02855-9071-43cc-89fb-a1870e8cc9a0 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa6a7aba33d4abd9389ecd2e3fa0906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e090451c7e4296a0b85c7eeb9002f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:20.349559 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-3ba02855-9071-43cc-89fb-a1870e8cc9a0 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] 10.222.0.30 "GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526" status: 200 len: 1266 microversion: 2.1 time: 0.171911 Nov 02 14:42:20.350952 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 187/396] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:20 2022] GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:21.130695 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-634b218b-d1a0-4c30-a450-3f5acc84ee4f tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:21.131872 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-634b218b-d1a0-4c30-a450-3f5acc84ee4f tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: bd91069f-ef45-44b0-a9c8-022d089d2dff] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:21.139057 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-634b218b-d1a0-4c30-a450-3f5acc84ee4f tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:21.139636 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-634b218b-d1a0-4c30-a450-3f5acc84ee4f tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:21.140099 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-634b218b-d1a0-4c30-a450-3f5acc84ee4f tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:21.140792 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-634b218b-d1a0-4c30-a450-3f5acc84ee4f tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:21.141264 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-634b218b-d1a0-4c30-a450-3f5acc84ee4f tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:21.142018 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-634b218b-d1a0-4c30-a450-3f5acc84ee4f tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:21.327795 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-8ead6e2d-e4b6-4292-8907-e44753a9e1c5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:21.334732 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-8ead6e2d-e4b6-4292-8907-e44753a9e1c5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:21.342092 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8ead6e2d-e4b6-4292-8907-e44753a9e1c5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:21.343764 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8ead6e2d-e4b6-4292-8907-e44753a9e1c5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:21.345083 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8ead6e2d-e4b6-4292-8907-e44753a9e1c5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:21.346806 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8ead6e2d-e4b6-4292-8907-e44753a9e1c5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:21.347464 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8ead6e2d-e4b6-4292-8907-e44753a9e1c5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:21.348071 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8ead6e2d-e4b6-4292-8907-e44753a9e1c5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:21.417457 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-634b218b-d1a0-4c30-a450-3f5acc84ee4f tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:21.426654 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-634b218b-d1a0-4c30-a450-3f5acc84ee4f tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff" status: 200 len: 1312 microversion: 2.1 time: 0.300588 Nov 02 14:42:21.431307 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 210/397] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:21 2022] GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff => generated 1312 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:21.433759 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-53d76564-91e0-4f61-ac40-099f39a3c1a5 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:21.434375 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-53d76564-91e0-4f61-ac40-099f39a3c1a5 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] [instance: 42424cc7-8d64-4aac-8fb8-405b40f5b526] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:21.444079 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-53d76564-91e0-4f61-ac40-099f39a3c1a5 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:21.444480 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-53d76564-91e0-4f61-ac40-099f39a3c1a5 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:21.445047 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-53d76564-91e0-4f61-ac40-099f39a3c1a5 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:21.445656 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-53d76564-91e0-4f61-ac40-099f39a3c1a5 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:21.447222 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-53d76564-91e0-4f61-ac40-099f39a3c1a5 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:21.447855 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-53d76564-91e0-4f61-ac40-099f39a3c1a5 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:21.571162 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-53d76564-91e0-4f61-ac40-099f39a3c1a5 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa6a7aba33d4abd9389ecd2e3fa0906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e090451c7e4296a0b85c7eeb9002f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:21.593741 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-53d76564-91e0-4f61-ac40-099f39a3c1a5 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] 10.222.0.30 "GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526" status: 200 len: 1272 microversion: 2.1 time: 0.164605 Nov 02 14:42:21.595926 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 211/398] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:21 2022] GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526 => generated 1272 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:21.660267 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-8ead6e2d-e4b6-4292-8907-e44753a9e1c5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:21.665692 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-8c4bba63-a0ff-4cd6-a420-f689f0fd5681 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "42637ed3-704d-4733-9c6a-e50bc32633fc"}} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:42:21.666732 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-8c4bba63-a0ff-4cd6-a420-f689f0fd5681 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:21.673439 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-8ead6e2d-e4b6-4292-8907-e44753a9e1c5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:21.674353 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8c4bba63-a0ff-4cd6-a420-f689f0fd5681 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:21.675050 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8c4bba63-a0ff-4cd6-a420-f689f0fd5681 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:21.675663 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8c4bba63-a0ff-4cd6-a420-f689f0fd5681 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:21.676580 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-8ead6e2d-e4b6-4292-8907-e44753a9e1c5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:21.676707 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8c4bba63-a0ff-4cd6-a420-f689f0fd5681 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:21.677148 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8c4bba63-a0ff-4cd6-a420-f689f0fd5681 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:21.677598 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8c4bba63-a0ff-4cd6-a420-f689f0fd5681 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:21.679101 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-8ead6e2d-e4b6-4292-8907-e44753a9e1c5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1751 microversion: 2.20 time: 0.356256 Nov 02 14:42:21.679675 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 188/399] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:42:21 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1751 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:42:22.453433 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-a9957fdc-d3a0-4372-9e02-a27cff482a77 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:22.454622 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-a9957fdc-d3a0-4372-9e02-a27cff482a77 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: bd91069f-ef45-44b0-a9c8-022d089d2dff] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:22.464514 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a9957fdc-d3a0-4372-9e02-a27cff482a77 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:22.470823 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a9957fdc-d3a0-4372-9e02-a27cff482a77 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:22.470823 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a9957fdc-d3a0-4372-9e02-a27cff482a77 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:22.470823 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a9957fdc-d3a0-4372-9e02-a27cff482a77 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:22.470823 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a9957fdc-d3a0-4372-9e02-a27cff482a77 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:22.471222 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a9957fdc-d3a0-4372-9e02-a27cff482a77 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:22.575009 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-8c4bba63-a0ff-4cd6-a420-f689f0fd5681 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "POST /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.915158 Nov 02 14:42:22.580124 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 212/400] 10.222.0.30 () {60 vars in 1323 bytes} [Wed Nov 2 14:42:21 2022] POST /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7/os-volume_attachments => generated 194 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:42:22.627636 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-f5ce2280-dcb0-4805-88a6-11954bb874ec tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:22.628723 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-f5ce2280-dcb0-4805-88a6-11954bb874ec tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] [instance: 42424cc7-8d64-4aac-8fb8-405b40f5b526] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:22.639243 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f5ce2280-dcb0-4805-88a6-11954bb874ec tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:22.639751 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f5ce2280-dcb0-4805-88a6-11954bb874ec tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:22.640186 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f5ce2280-dcb0-4805-88a6-11954bb874ec tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:22.641052 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f5ce2280-dcb0-4805-88a6-11954bb874ec tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:22.643626 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f5ce2280-dcb0-4805-88a6-11954bb874ec tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:22.644278 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f5ce2280-dcb0-4805-88a6-11954bb874ec tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:22.762066 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-a9957fdc-d3a0-4372-9e02-a27cff482a77 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:22.771516 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-a9957fdc-d3a0-4372-9e02-a27cff482a77 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff" status: 200 len: 1312 microversion: 2.1 time: 0.322140 Nov 02 14:42:22.785624 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 189/401] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:22 2022] GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff => generated 1312 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:42:22.794865 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-2529bce7-6f08-44ff-a4f7-4fad64f31ce5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:22.796021 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-2529bce7-6f08-44ff-a4f7-4fad64f31ce5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:22.802535 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2529bce7-6f08-44ff-a4f7-4fad64f31ce5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:22.803268 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2529bce7-6f08-44ff-a4f7-4fad64f31ce5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:22.803715 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2529bce7-6f08-44ff-a4f7-4fad64f31ce5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:22.804422 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2529bce7-6f08-44ff-a4f7-4fad64f31ce5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:22.804881 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2529bce7-6f08-44ff-a4f7-4fad64f31ce5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:22.805482 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2529bce7-6f08-44ff-a4f7-4fad64f31ce5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:22.920631 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-f5ce2280-dcb0-4805-88a6-11954bb874ec tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa6a7aba33d4abd9389ecd2e3fa0906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e090451c7e4296a0b85c7eeb9002f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:22.929038 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-f5ce2280-dcb0-4805-88a6-11954bb874ec tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] 10.222.0.30 "GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526" status: 200 len: 1314 microversion: 2.1 time: 0.307549 Nov 02 14:42:22.930914 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 213/402] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:22 2022] GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526 => generated 1314 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:23.037273 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-2529bce7-6f08-44ff-a4f7-4fad64f31ce5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:23.046401 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-2529bce7-6f08-44ff-a4f7-4fad64f31ce5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:23.048556 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-2529bce7-6f08-44ff-a4f7-4fad64f31ce5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:23.049915 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-2529bce7-6f08-44ff-a4f7-4fad64f31ce5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1753 microversion: 2.20 time: 0.263109 Nov 02 14:42:23.050471 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 190/403] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:42:22 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1753 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:42:23.510252 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [req-6600e313-83d4-4aef-86ba-a3d25bd86e02 req-c1b22b94-d24d-4845-ada1-d459ed1300fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42424cc7-8d64-4aac-8fb8-405b40f5b526", "tag": "ef464795-086c-4a51-be10-888615a9b1d0"}]} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:42:23.523724 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-6600e313-83d4-4aef-86ba-a3d25bd86e02 req-c1b22b94-d24d-4845-ada1-d459ed1300fc service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:23.524211 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-6600e313-83d4-4aef-86ba-a3d25bd86e02 req-c1b22b94-d24d-4845-ada1-d459ed1300fc service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:23.524676 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-6600e313-83d4-4aef-86ba-a3d25bd86e02 req-c1b22b94-d24d-4845-ada1-d459ed1300fc service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:23.536819 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.compute.server_external_events [req-6600e313-83d4-4aef-86ba-a3d25bd86e02 req-c1b22b94-d24d-4845-ada1-d459ed1300fc service nova] Creating event network-changed:ef464795-086c-4a51-be10-888615a9b1d0 for instance 42424cc7-8d64-4aac-8fb8-405b40f5b526 on hv-cinder-86236 Nov 02 14:42:23.542987 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [req-6600e313-83d4-4aef-86ba-a3d25bd86e02 req-c1b22b94-d24d-4845-ada1-d459ed1300fc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036175 Nov 02 14:42:23.543836 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 214/404] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:42:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:42:23.798218 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-602a8549-bff8-4ad5-9aa8-3f0ea901da56 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:23.798872 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-602a8549-bff8-4ad5-9aa8-3f0ea901da56 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: bd91069f-ef45-44b0-a9c8-022d089d2dff] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:23.805403 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-602a8549-bff8-4ad5-9aa8-3f0ea901da56 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:23.806197 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-602a8549-bff8-4ad5-9aa8-3f0ea901da56 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:23.806324 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-602a8549-bff8-4ad5-9aa8-3f0ea901da56 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:23.807030 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-602a8549-bff8-4ad5-9aa8-3f0ea901da56 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:23.807701 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-602a8549-bff8-4ad5-9aa8-3f0ea901da56 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:23.808129 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-602a8549-bff8-4ad5-9aa8-3f0ea901da56 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:23.952335 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-cb1f8c03-185b-4aaa-9120-4a4b3bdc7063 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:23.953167 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-cb1f8c03-185b-4aaa-9120-4a4b3bdc7063 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] [instance: 42424cc7-8d64-4aac-8fb8-405b40f5b526] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:23.965212 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-cb1f8c03-185b-4aaa-9120-4a4b3bdc7063 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:23.965803 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-cb1f8c03-185b-4aaa-9120-4a4b3bdc7063 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:23.966307 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-cb1f8c03-185b-4aaa-9120-4a4b3bdc7063 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:23.967072 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-cb1f8c03-185b-4aaa-9120-4a4b3bdc7063 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:23.967616 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-cb1f8c03-185b-4aaa-9120-4a4b3bdc7063 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:23.968584 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-cb1f8c03-185b-4aaa-9120-4a4b3bdc7063 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:24.033776 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-602a8549-bff8-4ad5-9aa8-3f0ea901da56 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:24.041497 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-602a8549-bff8-4ad5-9aa8-3f0ea901da56 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff" status: 200 len: 1312 microversion: 2.1 time: 0.247610 Nov 02 14:42:24.042063 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 191/405] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:23 2022] GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff => generated 1312 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:42:24.077805 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-ae6fa799-b0f9-492e-9000-ce805f661034 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:24.078520 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-ae6fa799-b0f9-492e-9000-ce805f661034 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:24.085995 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ae6fa799-b0f9-492e-9000-ce805f661034 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:24.086799 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ae6fa799-b0f9-492e-9000-ce805f661034 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:24.087315 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ae6fa799-b0f9-492e-9000-ce805f661034 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:24.088088 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ae6fa799-b0f9-492e-9000-ce805f661034 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:24.088617 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ae6fa799-b0f9-492e-9000-ce805f661034 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:24.089156 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ae6fa799-b0f9-492e-9000-ce805f661034 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:24.236290 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-cb1f8c03-185b-4aaa-9120-4a4b3bdc7063 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa6a7aba33d4abd9389ecd2e3fa0906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e090451c7e4296a0b85c7eeb9002f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:24.245608 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-cb1f8c03-185b-4aaa-9120-4a4b3bdc7063 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] 10.222.0.30 "GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526" status: 200 len: 1314 microversion: 2.1 time: 0.297360 Nov 02 14:42:24.247542 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 215/406] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:23 2022] GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526 => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:24.369668 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-ae6fa799-b0f9-492e-9000-ce805f661034 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:24.383782 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-ae6fa799-b0f9-492e-9000-ce805f661034 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:24.385310 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-ae6fa799-b0f9-492e-9000-ce805f661034 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:24.386492 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-ae6fa799-b0f9-492e-9000-ce805f661034 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1753 microversion: 2.20 time: 0.313209 Nov 02 14:42:24.387053 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 192/407] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:42:24 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1753 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:42:24.748667 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [req-3983183b-fd55-49e8-984e-15abae5937a6 req-590f73d0-992c-4615-92c9-bdffa00f8ea7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd91069f-ef45-44b0-a9c8-022d089d2dff", "name": "network-vif-plugged", "status": "completed", "tag": "bdeedfb0-c94b-4193-9d25-ca0bb97dc80d"}]} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:42:24.761041 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-3983183b-fd55-49e8-984e-15abae5937a6 req-590f73d0-992c-4615-92c9-bdffa00f8ea7 service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:24.761623 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-3983183b-fd55-49e8-984e-15abae5937a6 req-590f73d0-992c-4615-92c9-bdffa00f8ea7 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:24.762048 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-3983183b-fd55-49e8-984e-15abae5937a6 req-590f73d0-992c-4615-92c9-bdffa00f8ea7 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:24.778590 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.compute.server_external_events [req-3983183b-fd55-49e8-984e-15abae5937a6 req-590f73d0-992c-4615-92c9-bdffa00f8ea7 service nova] Creating event network-vif-plugged:bdeedfb0-c94b-4193-9d25-ca0bb97dc80d for instance bd91069f-ef45-44b0-a9c8-022d089d2dff on hv-cinder-86236 Nov 02 14:42:24.778590 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [req-3983183b-fd55-49e8-984e-15abae5937a6 req-590f73d0-992c-4615-92c9-bdffa00f8ea7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033775 Nov 02 14:42:24.779153 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 216/408] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:42:25.064875 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-4ec42273-3015-492d-9389-d675a8c08b3b tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:25.065567 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-4ec42273-3015-492d-9389-d675a8c08b3b tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: bd91069f-ef45-44b0-a9c8-022d089d2dff] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:25.071621 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4ec42273-3015-492d-9389-d675a8c08b3b tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:25.072107 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4ec42273-3015-492d-9389-d675a8c08b3b tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:25.072547 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4ec42273-3015-492d-9389-d675a8c08b3b tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:25.074323 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4ec42273-3015-492d-9389-d675a8c08b3b tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:25.074323 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4ec42273-3015-492d-9389-d675a8c08b3b tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:25.074323 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4ec42273-3015-492d-9389-d675a8c08b3b tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:25.205302 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-4ec42273-3015-492d-9389-d675a8c08b3b tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:25.213121 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-4ec42273-3015-492d-9389-d675a8c08b3b tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff" status: 200 len: 1312 microversion: 2.1 time: 0.152391 Nov 02 14:42:25.213692 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 193/409] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:25 2022] GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff => generated 1312 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:25.269767 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-bc51c3a1-0ea8-47ad-9c67-4c235102aced tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:25.270457 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-bc51c3a1-0ea8-47ad-9c67-4c235102aced tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] [instance: 42424cc7-8d64-4aac-8fb8-405b40f5b526] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:25.276701 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-bc51c3a1-0ea8-47ad-9c67-4c235102aced tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:25.277222 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-bc51c3a1-0ea8-47ad-9c67-4c235102aced tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:25.277657 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-bc51c3a1-0ea8-47ad-9c67-4c235102aced tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:25.278339 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-bc51c3a1-0ea8-47ad-9c67-4c235102aced tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:25.280854 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-bc51c3a1-0ea8-47ad-9c67-4c235102aced tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:25.280854 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-bc51c3a1-0ea8-47ad-9c67-4c235102aced tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:25.414002 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-bc51c3a1-0ea8-47ad-9c67-4c235102aced tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa6a7aba33d4abd9389ecd2e3fa0906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e090451c7e4296a0b85c7eeb9002f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:25.417790 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-0a66a0a8-f50c-4fff-a8fe-edb389c0af50 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:25.418399 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-0a66a0a8-f50c-4fff-a8fe-edb389c0af50 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:25.421273 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:42:25.422121 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-bc51c3a1-0ea8-47ad-9c67-4c235102aced tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] 10.222.0.30 "GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526" status: 200 len: 1314 microversion: 2.1 time: 0.156462 Nov 02 14:42:25.423189 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 217/410] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:25 2022] GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:25.425333 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0a66a0a8-f50c-4fff-a8fe-edb389c0af50 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:25.425822 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0a66a0a8-f50c-4fff-a8fe-edb389c0af50 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:25.426265 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0a66a0a8-f50c-4fff-a8fe-edb389c0af50 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:25.426961 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0a66a0a8-f50c-4fff-a8fe-edb389c0af50 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:25.427411 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0a66a0a8-f50c-4fff-a8fe-edb389c0af50 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:25.427838 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0a66a0a8-f50c-4fff-a8fe-edb389c0af50 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:25.562609 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-0a66a0a8-f50c-4fff-a8fe-edb389c0af50 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:25.571921 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-0a66a0a8-f50c-4fff-a8fe-edb389c0af50 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:25.573324 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-0a66a0a8-f50c-4fff-a8fe-edb389c0af50 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:25.574468 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-0a66a0a8-f50c-4fff-a8fe-edb389c0af50 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1809 microversion: 2.20 time: 0.160521 Nov 02 14:42:25.575018 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 194/411] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:42:25 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:42:26.236834 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-a11d102f-5474-4d59-bdba-dac61829e5e9 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:26.237467 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-a11d102f-5474-4d59-bdba-dac61829e5e9 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: bd91069f-ef45-44b0-a9c8-022d089d2dff] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:26.243879 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a11d102f-5474-4d59-bdba-dac61829e5e9 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:26.244355 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a11d102f-5474-4d59-bdba-dac61829e5e9 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:26.244790 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a11d102f-5474-4d59-bdba-dac61829e5e9 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:26.245502 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a11d102f-5474-4d59-bdba-dac61829e5e9 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:26.245951 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a11d102f-5474-4d59-bdba-dac61829e5e9 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:26.246376 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a11d102f-5474-4d59-bdba-dac61829e5e9 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:26.373014 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-a11d102f-5474-4d59-bdba-dac61829e5e9 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:26.380822 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-a11d102f-5474-4d59-bdba-dac61829e5e9 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff" status: 200 len: 1312 microversion: 2.1 time: 0.148733 Nov 02 14:42:26.381529 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 218/412] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:26 2022] GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff => generated 1312 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:26.445411 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-eecaf11d-276d-4cbb-a42e-92383b1aac07 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:26.446041 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-eecaf11d-276d-4cbb-a42e-92383b1aac07 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] [instance: 42424cc7-8d64-4aac-8fb8-405b40f5b526] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:26.451992 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-eecaf11d-276d-4cbb-a42e-92383b1aac07 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:26.452489 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-eecaf11d-276d-4cbb-a42e-92383b1aac07 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:26.452923 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-eecaf11d-276d-4cbb-a42e-92383b1aac07 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:26.453630 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-eecaf11d-276d-4cbb-a42e-92383b1aac07 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:26.454128 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-eecaf11d-276d-4cbb-a42e-92383b1aac07 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:26.454549 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-eecaf11d-276d-4cbb-a42e-92383b1aac07 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:26.589099 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-eecaf11d-276d-4cbb-a42e-92383b1aac07 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa6a7aba33d4abd9389ecd2e3fa0906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e090451c7e4296a0b85c7eeb9002f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:26.598064 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-eecaf11d-276d-4cbb-a42e-92383b1aac07 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] 10.222.0.30 "GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526" status: 200 len: 1314 microversion: 2.1 time: 0.156320 Nov 02 14:42:26.598915 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 195/413] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:26 2022] GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:26.603778 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-2e1baf53-1504-4152-b957-d840159cbb01 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:26.604383 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-2e1baf53-1504-4152-b957-d840159cbb01 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:26.607979 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:42:26.612197 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2e1baf53-1504-4152-b957-d840159cbb01 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:26.612751 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2e1baf53-1504-4152-b957-d840159cbb01 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:26.613239 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2e1baf53-1504-4152-b957-d840159cbb01 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:26.613937 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2e1baf53-1504-4152-b957-d840159cbb01 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:26.618342 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2e1baf53-1504-4152-b957-d840159cbb01 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:26.618342 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2e1baf53-1504-4152-b957-d840159cbb01 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:26.747631 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-2e1baf53-1504-4152-b957-d840159cbb01 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:26.756119 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-2e1baf53-1504-4152-b957-d840159cbb01 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:26.757595 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-2e1baf53-1504-4152-b957-d840159cbb01 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:26.758723 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-2e1baf53-1504-4152-b957-d840159cbb01 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1809 microversion: 2.20 time: 0.158985 Nov 02 14:42:26.759271 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 219/414] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:42:26 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:42:27.403168 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-489e5cd7-336b-4dea-b7e4-9e036cd215c7 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:27.403778 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-489e5cd7-336b-4dea-b7e4-9e036cd215c7 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: bd91069f-ef45-44b0-a9c8-022d089d2dff] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:27.405711 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell0:SELECT=18 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:42:27.410532 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-489e5cd7-336b-4dea-b7e4-9e036cd215c7 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:27.411017 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-489e5cd7-336b-4dea-b7e4-9e036cd215c7 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:27.411454 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-489e5cd7-336b-4dea-b7e4-9e036cd215c7 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:27.412140 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-489e5cd7-336b-4dea-b7e4-9e036cd215c7 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:27.412594 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-489e5cd7-336b-4dea-b7e4-9e036cd215c7 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:27.413047 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-489e5cd7-336b-4dea-b7e4-9e036cd215c7 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:27.545387 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-489e5cd7-336b-4dea-b7e4-9e036cd215c7 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:27.553818 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-489e5cd7-336b-4dea-b7e4-9e036cd215c7 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff" status: 200 len: 1312 microversion: 2.1 time: 0.154437 Nov 02 14:42:27.554385 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 196/415] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:27 2022] GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff => generated 1312 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:27.621460 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-b7fbe578-206d-4db2-8079-f8251e31bc3e tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:27.622091 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-b7fbe578-206d-4db2-8079-f8251e31bc3e tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] [instance: 42424cc7-8d64-4aac-8fb8-405b40f5b526] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:27.629378 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b7fbe578-206d-4db2-8079-f8251e31bc3e tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:27.629864 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b7fbe578-206d-4db2-8079-f8251e31bc3e tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:27.630299 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b7fbe578-206d-4db2-8079-f8251e31bc3e tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:27.630986 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b7fbe578-206d-4db2-8079-f8251e31bc3e tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:27.631434 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b7fbe578-206d-4db2-8079-f8251e31bc3e tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:27.631853 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b7fbe578-206d-4db2-8079-f8251e31bc3e tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:27.759415 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-b7fbe578-206d-4db2-8079-f8251e31bc3e tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa6a7aba33d4abd9389ecd2e3fa0906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e090451c7e4296a0b85c7eeb9002f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:27.768095 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-b7fbe578-206d-4db2-8079-f8251e31bc3e tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] 10.222.0.30 "GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526" status: 200 len: 1314 microversion: 2.1 time: 0.150207 Nov 02 14:42:27.768675 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 220/416] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:27 2022] GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:27.784099 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-079e7c13-6201-46ca-bf94-30dfa8a5a80a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:27.784710 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-079e7c13-6201-46ca-bf94-30dfa8a5a80a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:27.790606 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-079e7c13-6201-46ca-bf94-30dfa8a5a80a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:27.791096 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-079e7c13-6201-46ca-bf94-30dfa8a5a80a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:27.791537 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-079e7c13-6201-46ca-bf94-30dfa8a5a80a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:27.792225 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-079e7c13-6201-46ca-bf94-30dfa8a5a80a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:27.792677 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-079e7c13-6201-46ca-bf94-30dfa8a5a80a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:27.793131 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-079e7c13-6201-46ca-bf94-30dfa8a5a80a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:27.923487 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-079e7c13-6201-46ca-bf94-30dfa8a5a80a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:27.932346 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-079e7c13-6201-46ca-bf94-30dfa8a5a80a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:27.933812 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-079e7c13-6201-46ca-bf94-30dfa8a5a80a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:27.939609 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-079e7c13-6201-46ca-bf94-30dfa8a5a80a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1809 microversion: 2.20 time: 0.155355 Nov 02 14:42:27.939609 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 197/417] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:42:27 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:42:28.577416 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-49233c50-46ad-4856-9e79-7705b38505ac tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:28.578208 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-49233c50-46ad-4856-9e79-7705b38505ac tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: bd91069f-ef45-44b0-a9c8-022d089d2dff] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:28.580833 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell0:SELECT=2 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:42:28.585799 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-49233c50-46ad-4856-9e79-7705b38505ac tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:28.586279 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-49233c50-46ad-4856-9e79-7705b38505ac tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:28.586721 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-49233c50-46ad-4856-9e79-7705b38505ac tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:28.587428 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-49233c50-46ad-4856-9e79-7705b38505ac tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:28.587879 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-49233c50-46ad-4856-9e79-7705b38505ac tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:28.588678 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-49233c50-46ad-4856-9e79-7705b38505ac tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:28.792173 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-df6d2a31-2f4b-4d27-8cd0-d58bf4fc718d tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:28.792788 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-df6d2a31-2f4b-4d27-8cd0-d58bf4fc718d tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] [instance: 42424cc7-8d64-4aac-8fb8-405b40f5b526] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:28.799304 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-df6d2a31-2f4b-4d27-8cd0-d58bf4fc718d tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:28.799808 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-df6d2a31-2f4b-4d27-8cd0-d58bf4fc718d tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:28.800549 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-df6d2a31-2f4b-4d27-8cd0-d58bf4fc718d tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:28.801363 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-df6d2a31-2f4b-4d27-8cd0-d58bf4fc718d tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:28.802034 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-df6d2a31-2f4b-4d27-8cd0-d58bf4fc718d tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:28.802472 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-df6d2a31-2f4b-4d27-8cd0-d58bf4fc718d tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:28.818953 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-49233c50-46ad-4856-9e79-7705b38505ac tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:28.841654 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-49233c50-46ad-4856-9e79-7705b38505ac tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff" status: 200 len: 1312 microversion: 2.1 time: 0.268055 Nov 02 14:42:28.842261 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 221/418] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:28 2022] GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff => generated 1312 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:28.961306 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-537eaab6-a540-402d-8bad-0a5ad31b4734 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:28.961914 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-537eaab6-a540-402d-8bad-0a5ad31b4734 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:28.968956 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-537eaab6-a540-402d-8bad-0a5ad31b4734 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:28.969970 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-537eaab6-a540-402d-8bad-0a5ad31b4734 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:28.970382 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-537eaab6-a540-402d-8bad-0a5ad31b4734 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:28.971300 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-537eaab6-a540-402d-8bad-0a5ad31b4734 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:28.971896 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-537eaab6-a540-402d-8bad-0a5ad31b4734 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:28.972516 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-537eaab6-a540-402d-8bad-0a5ad31b4734 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:28.996687 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-df6d2a31-2f4b-4d27-8cd0-d58bf4fc718d tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa6a7aba33d4abd9389ecd2e3fa0906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e090451c7e4296a0b85c7eeb9002f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:29.005051 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-df6d2a31-2f4b-4d27-8cd0-d58bf4fc718d tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] 10.222.0.30 "GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526" status: 200 len: 1314 microversion: 2.1 time: 0.217668 Nov 02 14:42:29.005622 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 198/419] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:28 2022] GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:29.111439 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-537eaab6-a540-402d-8bad-0a5ad31b4734 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:29.121070 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-537eaab6-a540-402d-8bad-0a5ad31b4734 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:29.122779 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-537eaab6-a540-402d-8bad-0a5ad31b4734 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:29.123947 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-537eaab6-a540-402d-8bad-0a5ad31b4734 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1809 microversion: 2.20 time: 0.166555 Nov 02 14:42:29.124510 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 222/420] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:42:28 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:42:29.866830 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-43e6379a-7b0d-4aaa-9f5d-4d85d4025c7a tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:29.867428 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-43e6379a-7b0d-4aaa-9f5d-4d85d4025c7a tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: bd91069f-ef45-44b0-a9c8-022d089d2dff] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:29.869418 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell0:SELECT=6 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:42:29.874592 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-43e6379a-7b0d-4aaa-9f5d-4d85d4025c7a tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:29.875193 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-43e6379a-7b0d-4aaa-9f5d-4d85d4025c7a tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:29.875898 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-43e6379a-7b0d-4aaa-9f5d-4d85d4025c7a tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:29.877267 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-43e6379a-7b0d-4aaa-9f5d-4d85d4025c7a tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:29.877867 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-43e6379a-7b0d-4aaa-9f5d-4d85d4025c7a tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:29.878409 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-43e6379a-7b0d-4aaa-9f5d-4d85d4025c7a tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:29.883985 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell1:SELECT=100 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:42:30.025274 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-43e6379a-7b0d-4aaa-9f5d-4d85d4025c7a tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:30.028925 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-af860eee-5552-4fd1-8f41-febeb6509f16 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:30.035834 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-af860eee-5552-4fd1-8f41-febeb6509f16 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] [instance: 42424cc7-8d64-4aac-8fb8-405b40f5b526] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:30.036080 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-43e6379a-7b0d-4aaa-9f5d-4d85d4025c7a tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff" status: 200 len: 1312 microversion: 2.1 time: 0.171454 Nov 02 14:42:30.036080 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 199/421] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:29 2022] GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff => generated 1312 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:30.037719 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-af860eee-5552-4fd1-8f41-febeb6509f16 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:30.038677 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-af860eee-5552-4fd1-8f41-febeb6509f16 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:30.039519 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-af860eee-5552-4fd1-8f41-febeb6509f16 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:30.040395 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-af860eee-5552-4fd1-8f41-febeb6509f16 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:30.041300 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-af860eee-5552-4fd1-8f41-febeb6509f16 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:30.041869 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-af860eee-5552-4fd1-8f41-febeb6509f16 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:30.153898 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-9f80b070-324f-4edf-8fc6-0ce3458afc7c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:30.154606 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-9f80b070-324f-4edf-8fc6-0ce3458afc7c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:30.161513 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9f80b070-324f-4edf-8fc6-0ce3458afc7c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:30.162087 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9f80b070-324f-4edf-8fc6-0ce3458afc7c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:30.162512 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9f80b070-324f-4edf-8fc6-0ce3458afc7c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:30.163231 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9f80b070-324f-4edf-8fc6-0ce3458afc7c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:30.163690 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9f80b070-324f-4edf-8fc6-0ce3458afc7c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:30.164121 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9f80b070-324f-4edf-8fc6-0ce3458afc7c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:30.179432 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-af860eee-5552-4fd1-8f41-febeb6509f16 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa6a7aba33d4abd9389ecd2e3fa0906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e090451c7e4296a0b85c7eeb9002f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:30.187427 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-af860eee-5552-4fd1-8f41-febeb6509f16 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] 10.222.0.30 "GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526" status: 200 len: 1314 microversion: 2.1 time: 0.163270 Nov 02 14:42:30.188261 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 223/422] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:30 2022] GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:30.307962 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-9f80b070-324f-4edf-8fc6-0ce3458afc7c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:30.317139 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-9f80b070-324f-4edf-8fc6-0ce3458afc7c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:30.318580 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-9f80b070-324f-4edf-8fc6-0ce3458afc7c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:30.319792 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-9f80b070-324f-4edf-8fc6-0ce3458afc7c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1809 microversion: 2.20 time: 0.169808 Nov 02 14:42:30.320353 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 200/423] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:42:30 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:42:31.057662 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-a23f8754-903e-44ba-a5c9-c44c00052152 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:31.058336 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-a23f8754-903e-44ba-a5c9-c44c00052152 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: bd91069f-ef45-44b0-a9c8-022d089d2dff] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:31.066402 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a23f8754-903e-44ba-a5c9-c44c00052152 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:31.066894 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a23f8754-903e-44ba-a5c9-c44c00052152 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:31.067513 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a23f8754-903e-44ba-a5c9-c44c00052152 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:31.068399 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a23f8754-903e-44ba-a5c9-c44c00052152 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:31.068858 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a23f8754-903e-44ba-a5c9-c44c00052152 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:31.069319 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a23f8754-903e-44ba-a5c9-c44c00052152 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:31.223519 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-a9f1bf7f-7598-42af-9c85-88d8fc91a11a tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:31.224218 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-a9f1bf7f-7598-42af-9c85-88d8fc91a11a tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] [instance: 42424cc7-8d64-4aac-8fb8-405b40f5b526] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:31.230380 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a9f1bf7f-7598-42af-9c85-88d8fc91a11a tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:31.230957 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a9f1bf7f-7598-42af-9c85-88d8fc91a11a tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:31.231768 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a9f1bf7f-7598-42af-9c85-88d8fc91a11a tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:31.232745 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a9f1bf7f-7598-42af-9c85-88d8fc91a11a tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:31.233237 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a9f1bf7f-7598-42af-9c85-88d8fc91a11a tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:31.233672 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a9f1bf7f-7598-42af-9c85-88d8fc91a11a tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:31.353749 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-a23f8754-903e-44ba-a5c9-c44c00052152 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:31.383434 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-a23f8754-903e-44ba-a5c9-c44c00052152 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff" status: 200 len: 1495 microversion: 2.1 time: 0.326901 Nov 02 14:42:31.386476 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 224/424] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:31 2022] GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff => generated 1495 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:31.396450 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-dc90e635-f5c8-47b0-b035-84e7faf11d81 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:31.400076 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-dc90e635-f5c8-47b0-b035-84e7faf11d81 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:31.422954 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-dc90e635-f5c8-47b0-b035-84e7faf11d81 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:31.424501 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-dc90e635-f5c8-47b0-b035-84e7faf11d81 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:31.425623 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-dc90e635-f5c8-47b0-b035-84e7faf11d81 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:31.428896 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-dc90e635-f5c8-47b0-b035-84e7faf11d81 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:31.430823 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-dc90e635-f5c8-47b0-b035-84e7faf11d81 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:31.432559 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-dc90e635-f5c8-47b0-b035-84e7faf11d81 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:31.488687 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-a9f1bf7f-7598-42af-9c85-88d8fc91a11a tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa6a7aba33d4abd9389ecd2e3fa0906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e090451c7e4296a0b85c7eeb9002f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:31.495102 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-a9f1bf7f-7598-42af-9c85-88d8fc91a11a tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] 10.222.0.30 "GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526" status: 200 len: 1314 microversion: 2.1 time: 0.275996 Nov 02 14:42:31.495713 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 201/425] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:31 2022] GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526 => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:42:31.687833 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-dc90e635-f5c8-47b0-b035-84e7faf11d81 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:31.698524 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-dc90e635-f5c8-47b0-b035-84e7faf11d81 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:31.700056 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-dc90e635-f5c8-47b0-b035-84e7faf11d81 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:31.701329 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-dc90e635-f5c8-47b0-b035-84e7faf11d81 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1809 microversion: 2.20 time: 0.313494 Nov 02 14:42:31.717738 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 225/426] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:42:31 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1809 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:42:32.518720 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-fc3f04de-d13d-4aaf-ae61-942d0fc5628a tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:32.519675 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-fc3f04de-d13d-4aaf-ae61-942d0fc5628a tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] [instance: 42424cc7-8d64-4aac-8fb8-405b40f5b526] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:32.527413 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-fc3f04de-d13d-4aaf-ae61-942d0fc5628a tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:32.528121 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-fc3f04de-d13d-4aaf-ae61-942d0fc5628a tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:32.528718 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-fc3f04de-d13d-4aaf-ae61-942d0fc5628a tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:32.529940 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-fc3f04de-d13d-4aaf-ae61-942d0fc5628a tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:32.530558 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-fc3f04de-d13d-4aaf-ae61-942d0fc5628a tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:32.531155 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-fc3f04de-d13d-4aaf-ae61-942d0fc5628a tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:32.642556 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-330ac028-e411-43fc-8525-913c68d75e72 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:32.643252 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-330ac028-e411-43fc-8525-913c68d75e72 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: bd91069f-ef45-44b0-a9c8-022d089d2dff] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:32.650616 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-330ac028-e411-43fc-8525-913c68d75e72 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:32.651263 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-330ac028-e411-43fc-8525-913c68d75e72 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:32.652110 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-330ac028-e411-43fc-8525-913c68d75e72 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:32.658143 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-330ac028-e411-43fc-8525-913c68d75e72 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:32.658143 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-330ac028-e411-43fc-8525-913c68d75e72 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:32.658143 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-330ac028-e411-43fc-8525-913c68d75e72 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:32.660352 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:42:32.685982 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-330ac028-e411-43fc-8525-913c68d75e72 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: bd91069f-ef45-44b0-a9c8-022d089d2dff] Going to try to terminate instance {{(pid=119659) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:42:32.718241 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-fc3f04de-d13d-4aaf-ae61-942d0fc5628a tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa6a7aba33d4abd9389ecd2e3fa0906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e090451c7e4296a0b85c7eeb9002f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:32.734083 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-fc3f04de-d13d-4aaf-ae61-942d0fc5628a tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] 10.222.0.30 "GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526" status: 200 len: 1314 microversion: 2.1 time: 0.219439 Nov 02 14:42:32.735849 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 202/427] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:32 2022] GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:32.740912 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-2f41e708-e1ef-4477-a690-f820ac6f56b5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:32.741763 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-2f41e708-e1ef-4477-a690-f820ac6f56b5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:32.749389 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2f41e708-e1ef-4477-a690-f820ac6f56b5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:32.749389 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2f41e708-e1ef-4477-a690-f820ac6f56b5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:32.749751 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2f41e708-e1ef-4477-a690-f820ac6f56b5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:32.750702 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2f41e708-e1ef-4477-a690-f820ac6f56b5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:32.751934 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2f41e708-e1ef-4477-a690-f820ac6f56b5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:32.752365 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2f41e708-e1ef-4477-a690-f820ac6f56b5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:32.988992 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-2f41e708-e1ef-4477-a690-f820ac6f56b5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:32.999082 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-2f41e708-e1ef-4477-a690-f820ac6f56b5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:33.000860 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-2f41e708-e1ef-4477-a690-f820ac6f56b5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:33.002731 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-2f41e708-e1ef-4477-a690-f820ac6f56b5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1809 microversion: 2.20 time: 0.265579 Nov 02 14:42:33.006136 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 203/428] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:42:32 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1809 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:42:33.009325 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [req-27fd8d93-3a99-4ec0-8b49-fc408c005a3b req-2169234e-9750-49f5-9c68-bab027cadae7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42424cc7-8d64-4aac-8fb8-405b40f5b526", "name": "network-vif-plugged", "status": "completed", "tag": "ef464795-086c-4a51-be10-888615a9b1d0"}]} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:42:33.019582 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-27fd8d93-3a99-4ec0-8b49-fc408c005a3b req-2169234e-9750-49f5-9c68-bab027cadae7 service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:33.020207 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-27fd8d93-3a99-4ec0-8b49-fc408c005a3b req-2169234e-9750-49f5-9c68-bab027cadae7 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:33.020734 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-27fd8d93-3a99-4ec0-8b49-fc408c005a3b req-2169234e-9750-49f5-9c68-bab027cadae7 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:33.033543 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.compute.server_external_events [req-27fd8d93-3a99-4ec0-8b49-fc408c005a3b req-2169234e-9750-49f5-9c68-bab027cadae7 service nova] Creating event network-vif-plugged:ef464795-086c-4a51-be10-888615a9b1d0 for instance 42424cc7-8d64-4aac-8fb8-405b40f5b526 on hv-cinder-86236 Nov 02 14:42:33.039151 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-330ac028-e411-43fc-8525-913c68d75e72 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "DELETE /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff" status: 204 len: 0 microversion: 2.1 time: 0.400970 Nov 02 14:42:33.040076 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 226/429] 10.222.0.30 () {58 vars in 1239 bytes} [Wed Nov 2 14:42:32 2022] DELETE /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:42:33.040654 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [req-27fd8d93-3a99-4ec0-8b49-fc408c005a3b req-2169234e-9750-49f5-9c68-bab027cadae7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035530 Nov 02 14:42:33.046835 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 204/430] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:42:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:42:33.057064 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-8e898835-739c-4f19-ad6c-aada2961bef7 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:33.057802 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-8e898835-739c-4f19-ad6c-aada2961bef7 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: bd91069f-ef45-44b0-a9c8-022d089d2dff] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:33.065115 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8e898835-739c-4f19-ad6c-aada2961bef7 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:33.065882 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8e898835-739c-4f19-ad6c-aada2961bef7 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:33.066321 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8e898835-739c-4f19-ad6c-aada2961bef7 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:33.067026 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8e898835-739c-4f19-ad6c-aada2961bef7 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:33.067477 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8e898835-739c-4f19-ad6c-aada2961bef7 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:33.067901 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8e898835-739c-4f19-ad6c-aada2961bef7 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:33.264309 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-8e898835-739c-4f19-ad6c-aada2961bef7 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:33.269244 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-8e898835-739c-4f19-ad6c-aada2961bef7 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff" status: 200 len: 1501 microversion: 2.1 time: 0.216395 Nov 02 14:42:33.270028 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 227/431] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:33 2022] GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff => generated 1501 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:33.764730 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-97ca0648-5435-4674-8f16-e91493dad24d tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:33.766116 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-97ca0648-5435-4674-8f16-e91493dad24d tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] [instance: 42424cc7-8d64-4aac-8fb8-405b40f5b526] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:33.773444 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-97ca0648-5435-4674-8f16-e91493dad24d tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:33.774172 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-97ca0648-5435-4674-8f16-e91493dad24d tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:33.774762 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-97ca0648-5435-4674-8f16-e91493dad24d tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:33.775614 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-97ca0648-5435-4674-8f16-e91493dad24d tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:33.776243 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-97ca0648-5435-4674-8f16-e91493dad24d tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:33.776896 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-97ca0648-5435-4674-8f16-e91493dad24d tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:34.058426 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-97ca0648-5435-4674-8f16-e91493dad24d tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa6a7aba33d4abd9389ecd2e3fa0906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e090451c7e4296a0b85c7eeb9002f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:34.058426 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-97ca0648-5435-4674-8f16-e91493dad24d tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] 10.222.0.30 "GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526" status: 200 len: 1314 microversion: 2.1 time: 0.224416 Nov 02 14:42:34.058426 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 205/432] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:33 2022] GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:34.059469 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-e9faf173-f44d-4626-adfc-a33473edb80f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:34.059469 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-e9faf173-f44d-4626-adfc-a33473edb80f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:34.059469 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e9faf173-f44d-4626-adfc-a33473edb80f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:34.059469 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e9faf173-f44d-4626-adfc-a33473edb80f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:34.060203 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e9faf173-f44d-4626-adfc-a33473edb80f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:34.060203 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e9faf173-f44d-4626-adfc-a33473edb80f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:34.060203 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e9faf173-f44d-4626-adfc-a33473edb80f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:34.060203 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e9faf173-f44d-4626-adfc-a33473edb80f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:34.203230 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-e9faf173-f44d-4626-adfc-a33473edb80f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:34.214908 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-e9faf173-f44d-4626-adfc-a33473edb80f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:34.217051 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-e9faf173-f44d-4626-adfc-a33473edb80f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:34.218537 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-e9faf173-f44d-4626-adfc-a33473edb80f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1809 microversion: 2.20 time: 0.192037 Nov 02 14:42:34.219933 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 228/433] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:42:34 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1809 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:42:34.296281 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-494fe5bc-6313-4fca-b475-a97295051ddb tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:34.296980 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-494fe5bc-6313-4fca-b475-a97295051ddb tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: bd91069f-ef45-44b0-a9c8-022d089d2dff] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:34.305596 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-494fe5bc-6313-4fca-b475-a97295051ddb tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:34.306499 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-494fe5bc-6313-4fca-b475-a97295051ddb tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:34.307250 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-494fe5bc-6313-4fca-b475-a97295051ddb tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:34.308392 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-494fe5bc-6313-4fca-b475-a97295051ddb tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:34.309156 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-494fe5bc-6313-4fca-b475-a97295051ddb tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:34.309854 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-494fe5bc-6313-4fca-b475-a97295051ddb tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:34.476812 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-494fe5bc-6313-4fca-b475-a97295051ddb tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:34.488109 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-494fe5bc-6313-4fca-b475-a97295051ddb tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff" status: 200 len: 1501 microversion: 2.1 time: 0.194838 Nov 02 14:42:34.488715 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 206/434] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:34 2022] GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff => generated 1501 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:35.080439 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-83e062c5-f740-430a-9a57-0dacc07c3f95 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:35.080439 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-83e062c5-f740-430a-9a57-0dacc07c3f95 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] [instance: 42424cc7-8d64-4aac-8fb8-405b40f5b526] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:35.080439 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-83e062c5-f740-430a-9a57-0dacc07c3f95 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:35.081413 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-83e062c5-f740-430a-9a57-0dacc07c3f95 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:35.081413 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-83e062c5-f740-430a-9a57-0dacc07c3f95 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:35.081977 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-83e062c5-f740-430a-9a57-0dacc07c3f95 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:35.082429 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-83e062c5-f740-430a-9a57-0dacc07c3f95 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:35.082852 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-83e062c5-f740-430a-9a57-0dacc07c3f95 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:35.249819 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-83e062c5-f740-430a-9a57-0dacc07c3f95 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa6a7aba33d4abd9389ecd2e3fa0906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e090451c7e4296a0b85c7eeb9002f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:35.255680 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-c0908c40-07d3-4a61-b4ce-a90813d54ecb tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:35.256443 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-c0908c40-07d3-4a61-b4ce-a90813d54ecb tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:35.260379 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-83e062c5-f740-430a-9a57-0dacc07c3f95 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] 10.222.0.30 "GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526" status: 200 len: 1314 microversion: 2.1 time: 0.192417 Nov 02 14:42:35.265028 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 229/435] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:35 2022] GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:35.265154 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c0908c40-07d3-4a61-b4ce-a90813d54ecb tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:35.265154 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c0908c40-07d3-4a61-b4ce-a90813d54ecb tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:35.265154 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c0908c40-07d3-4a61-b4ce-a90813d54ecb tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:35.265692 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c0908c40-07d3-4a61-b4ce-a90813d54ecb tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:35.266141 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c0908c40-07d3-4a61-b4ce-a90813d54ecb tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:35.267147 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c0908c40-07d3-4a61-b4ce-a90813d54ecb tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:35.443058 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-c0908c40-07d3-4a61-b4ce-a90813d54ecb tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:35.454011 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-c0908c40-07d3-4a61-b4ce-a90813d54ecb tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:35.455922 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-c0908c40-07d3-4a61-b4ce-a90813d54ecb tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:35.457593 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-c0908c40-07d3-4a61-b4ce-a90813d54ecb tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1809 microversion: 2.20 time: 0.206162 Nov 02 14:42:35.458151 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 207/436] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:42:35 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1809 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:42:35.511643 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-4c1e363c-be57-4471-b17d-29f9ae9ca6ef tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:35.512260 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-4c1e363c-be57-4471-b17d-29f9ae9ca6ef tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: bd91069f-ef45-44b0-a9c8-022d089d2dff] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:35.518437 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4c1e363c-be57-4471-b17d-29f9ae9ca6ef tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:35.518920 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4c1e363c-be57-4471-b17d-29f9ae9ca6ef tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:35.519354 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4c1e363c-be57-4471-b17d-29f9ae9ca6ef tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:35.520056 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4c1e363c-be57-4471-b17d-29f9ae9ca6ef tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:35.520504 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4c1e363c-be57-4471-b17d-29f9ae9ca6ef tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:35.520929 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4c1e363c-be57-4471-b17d-29f9ae9ca6ef tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:35.699448 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-4c1e363c-be57-4471-b17d-29f9ae9ca6ef tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:35.708858 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-4c1e363c-be57-4471-b17d-29f9ae9ca6ef tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff" status: 200 len: 1501 microversion: 2.1 time: 0.200958 Nov 02 14:42:35.709787 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 230/437] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:35 2022] GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff => generated 1501 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:36.289228 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-c0206320-36f0-48f4-a32b-1aa5ef2b4376 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:36.290486 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-c0206320-36f0-48f4-a32b-1aa5ef2b4376 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] [instance: 42424cc7-8d64-4aac-8fb8-405b40f5b526] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:36.300110 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c0206320-36f0-48f4-a32b-1aa5ef2b4376 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:36.300934 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c0206320-36f0-48f4-a32b-1aa5ef2b4376 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:36.301718 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c0206320-36f0-48f4-a32b-1aa5ef2b4376 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:36.302906 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c0206320-36f0-48f4-a32b-1aa5ef2b4376 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:36.303699 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c0206320-36f0-48f4-a32b-1aa5ef2b4376 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:36.304423 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c0206320-36f0-48f4-a32b-1aa5ef2b4376 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:36.484091 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-7f081dba-924c-4c55-b769-5b33fa773161 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:36.485567 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-7f081dba-924c-4c55-b769-5b33fa773161 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:36.491833 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-c0206320-36f0-48f4-a32b-1aa5ef2b4376 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa6a7aba33d4abd9389ecd2e3fa0906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e090451c7e4296a0b85c7eeb9002f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:36.503565 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-c0206320-36f0-48f4-a32b-1aa5ef2b4376 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] 10.222.0.30 "GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526" status: 200 len: 1314 microversion: 2.1 time: 0.218729 Nov 02 14:42:36.504790 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 208/438] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:36 2022] GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:42:36.506949 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7f081dba-924c-4c55-b769-5b33fa773161 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:36.508436 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7f081dba-924c-4c55-b769-5b33fa773161 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:36.509278 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7f081dba-924c-4c55-b769-5b33fa773161 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:36.510270 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7f081dba-924c-4c55-b769-5b33fa773161 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:36.510895 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7f081dba-924c-4c55-b769-5b33fa773161 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:36.511322 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7f081dba-924c-4c55-b769-5b33fa773161 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:36.701057 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-7f081dba-924c-4c55-b769-5b33fa773161 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:36.712674 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-7f081dba-924c-4c55-b769-5b33fa773161 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:36.714226 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-7f081dba-924c-4c55-b769-5b33fa773161 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:36.716169 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-7f081dba-924c-4c55-b769-5b33fa773161 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1809 microversion: 2.20 time: 0.235645 Nov 02 14:42:36.717299 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 231/439] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:42:36 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1809 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:42:36.743373 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-c56cb9e4-2f9d-4bb6-951c-33e945e9bf34 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:36.744256 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-c56cb9e4-2f9d-4bb6-951c-33e945e9bf34 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: bd91069f-ef45-44b0-a9c8-022d089d2dff] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:36.752169 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c56cb9e4-2f9d-4bb6-951c-33e945e9bf34 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:36.752651 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c56cb9e4-2f9d-4bb6-951c-33e945e9bf34 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:36.753121 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c56cb9e4-2f9d-4bb6-951c-33e945e9bf34 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:36.753827 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c56cb9e4-2f9d-4bb6-951c-33e945e9bf34 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:36.754335 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c56cb9e4-2f9d-4bb6-951c-33e945e9bf34 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:36.754763 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c56cb9e4-2f9d-4bb6-951c-33e945e9bf34 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:36.900713 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-c56cb9e4-2f9d-4bb6-951c-33e945e9bf34 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:36.913497 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-c56cb9e4-2f9d-4bb6-951c-33e945e9bf34 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff" status: 200 len: 1501 microversion: 2.1 time: 0.174731 Nov 02 14:42:36.914589 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 209/440] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:36 2022] GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff => generated 1501 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:37.527456 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-de194571-df65-4d1f-825b-192f62c4fc6f tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:37.528116 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-de194571-df65-4d1f-825b-192f62c4fc6f tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] [instance: 42424cc7-8d64-4aac-8fb8-405b40f5b526] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:37.534777 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-de194571-df65-4d1f-825b-192f62c4fc6f tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:37.535544 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-de194571-df65-4d1f-825b-192f62c4fc6f tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:37.536144 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-de194571-df65-4d1f-825b-192f62c4fc6f tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:37.536842 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-de194571-df65-4d1f-825b-192f62c4fc6f tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:37.537324 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-de194571-df65-4d1f-825b-192f62c4fc6f tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:37.537750 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-de194571-df65-4d1f-825b-192f62c4fc6f tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:37.702839 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-de194571-df65-4d1f-825b-192f62c4fc6f tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa6a7aba33d4abd9389ecd2e3fa0906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e090451c7e4296a0b85c7eeb9002f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:37.711304 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-de194571-df65-4d1f-825b-192f62c4fc6f tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] 10.222.0.30 "GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526" status: 200 len: 1314 microversion: 2.1 time: 0.187658 Nov 02 14:42:37.711879 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 232/441] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:37 2022] GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:37.747315 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-04da91b3-24ac-4e82-8206-2155140c50db tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:37.748598 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-04da91b3-24ac-4e82-8206-2155140c50db tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:37.756191 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-04da91b3-24ac-4e82-8206-2155140c50db tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:37.757139 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-04da91b3-24ac-4e82-8206-2155140c50db tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:37.757766 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-04da91b3-24ac-4e82-8206-2155140c50db tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:37.758657 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-04da91b3-24ac-4e82-8206-2155140c50db tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:37.759325 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-04da91b3-24ac-4e82-8206-2155140c50db tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:37.759907 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-04da91b3-24ac-4e82-8206-2155140c50db tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:37.917671 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-04da91b3-24ac-4e82-8206-2155140c50db tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:37.930745 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-04da91b3-24ac-4e82-8206-2155140c50db tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:37.932215 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-04da91b3-24ac-4e82-8206-2155140c50db tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:37.933425 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-04da91b3-24ac-4e82-8206-2155140c50db tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1809 microversion: 2.20 time: 0.190813 Nov 02 14:42:37.933989 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 210/442] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:42:37 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1809 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:42:37.939167 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-d45445aa-a03b-4d27-9f43-9130f008822d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:37.939789 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-d45445aa-a03b-4d27-9f43-9130f008822d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: bd91069f-ef45-44b0-a9c8-022d089d2dff] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:37.948244 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d45445aa-a03b-4d27-9f43-9130f008822d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:37.948885 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d45445aa-a03b-4d27-9f43-9130f008822d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:37.950680 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d45445aa-a03b-4d27-9f43-9130f008822d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:37.950680 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d45445aa-a03b-4d27-9f43-9130f008822d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:37.950680 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d45445aa-a03b-4d27-9f43-9130f008822d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:37.950950 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d45445aa-a03b-4d27-9f43-9130f008822d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:38.108569 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-d45445aa-a03b-4d27-9f43-9130f008822d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:38.116796 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-d45445aa-a03b-4d27-9f43-9130f008822d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff" status: 200 len: 1501 microversion: 2.1 time: 0.183124 Nov 02 14:42:38.117393 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 233/443] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:37 2022] GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff => generated 1501 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:42:38.736053 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-78077763-3324-4429-9f0b-9e75cf87daa3 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:38.736764 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-78077763-3324-4429-9f0b-9e75cf87daa3 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] [instance: 42424cc7-8d64-4aac-8fb8-405b40f5b526] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:38.743069 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-78077763-3324-4429-9f0b-9e75cf87daa3 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:38.743563 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-78077763-3324-4429-9f0b-9e75cf87daa3 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:38.743999 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-78077763-3324-4429-9f0b-9e75cf87daa3 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:38.744692 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-78077763-3324-4429-9f0b-9e75cf87daa3 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:38.745215 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-78077763-3324-4429-9f0b-9e75cf87daa3 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:38.745636 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-78077763-3324-4429-9f0b-9e75cf87daa3 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:38.905106 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-78077763-3324-4429-9f0b-9e75cf87daa3 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa6a7aba33d4abd9389ecd2e3fa0906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e090451c7e4296a0b85c7eeb9002f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:38.916281 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-78077763-3324-4429-9f0b-9e75cf87daa3 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] 10.222.0.30 "GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526" status: 200 len: 1314 microversion: 2.1 time: 0.185212 Nov 02 14:42:38.917787 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 211/444] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:38 2022] GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:38.960433 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-bc42f983-e0aa-46e3-b719-ac1c29487159 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:38.961055 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-bc42f983-e0aa-46e3-b719-ac1c29487159 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:38.967759 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-bc42f983-e0aa-46e3-b719-ac1c29487159 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:38.968294 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-bc42f983-e0aa-46e3-b719-ac1c29487159 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:38.968753 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-bc42f983-e0aa-46e3-b719-ac1c29487159 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:38.969527 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-bc42f983-e0aa-46e3-b719-ac1c29487159 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:38.970478 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-bc42f983-e0aa-46e3-b719-ac1c29487159 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:38.970893 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-bc42f983-e0aa-46e3-b719-ac1c29487159 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:39.117688 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-bc42f983-e0aa-46e3-b719-ac1c29487159 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:39.127312 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-bc42f983-e0aa-46e3-b719-ac1c29487159 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:39.128730 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-bc42f983-e0aa-46e3-b719-ac1c29487159 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:39.129955 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-bc42f983-e0aa-46e3-b719-ac1c29487159 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1809 microversion: 2.20 time: 0.173408 Nov 02 14:42:39.130694 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 234/445] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:42:38 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:42:39.139683 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-6e57dbb8-5576-407c-9029-35049b87adfc tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:39.140293 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-6e57dbb8-5576-407c-9029-35049b87adfc tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: bd91069f-ef45-44b0-a9c8-022d089d2dff] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:39.147497 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6e57dbb8-5576-407c-9029-35049b87adfc tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:39.148209 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6e57dbb8-5576-407c-9029-35049b87adfc tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:39.148836 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6e57dbb8-5576-407c-9029-35049b87adfc tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:39.149570 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6e57dbb8-5576-407c-9029-35049b87adfc tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:39.150023 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6e57dbb8-5576-407c-9029-35049b87adfc tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:39.150450 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6e57dbb8-5576-407c-9029-35049b87adfc tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:39.294471 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-6e57dbb8-5576-407c-9029-35049b87adfc tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:39.303521 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-6e57dbb8-5576-407c-9029-35049b87adfc tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff" status: 200 len: 1501 microversion: 2.1 time: 0.167545 Nov 02 14:42:39.304105 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 212/446] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:39 2022] GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff => generated 1501 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:39.942968 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-6243774d-63ef-408d-9568-d30931041b2f tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:39.943895 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-6243774d-63ef-408d-9568-d30931041b2f tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] [instance: 42424cc7-8d64-4aac-8fb8-405b40f5b526] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:39.952871 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6243774d-63ef-408d-9568-d30931041b2f tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:39.953653 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6243774d-63ef-408d-9568-d30931041b2f tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:39.954589 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6243774d-63ef-408d-9568-d30931041b2f tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:39.956237 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6243774d-63ef-408d-9568-d30931041b2f tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:39.957036 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6243774d-63ef-408d-9568-d30931041b2f tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:39.957791 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6243774d-63ef-408d-9568-d30931041b2f tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:40.133744 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-6243774d-63ef-408d-9568-d30931041b2f tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa6a7aba33d4abd9389ecd2e3fa0906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e090451c7e4296a0b85c7eeb9002f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:40.141484 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-6243774d-63ef-408d-9568-d30931041b2f tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] 10.222.0.30 "GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526" status: 200 len: 1314 microversion: 2.1 time: 0.205043 Nov 02 14:42:40.143525 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 235/447] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:39 2022] GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:40.165318 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-40850b57-8b7c-4975-98d2-5b95cac46edb tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:40.166838 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-40850b57-8b7c-4975-98d2-5b95cac46edb tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:40.176095 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-40850b57-8b7c-4975-98d2-5b95cac46edb tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:40.176587 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-40850b57-8b7c-4975-98d2-5b95cac46edb tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:40.178408 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-40850b57-8b7c-4975-98d2-5b95cac46edb tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:40.178408 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-40850b57-8b7c-4975-98d2-5b95cac46edb tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:40.178408 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-40850b57-8b7c-4975-98d2-5b95cac46edb tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:40.178708 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-40850b57-8b7c-4975-98d2-5b95cac46edb tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:40.334624 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-3dd36bba-1de1-443f-b9bc-687cfdb7708d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:40.335579 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-3dd36bba-1de1-443f-b9bc-687cfdb7708d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: bd91069f-ef45-44b0-a9c8-022d089d2dff] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:40.341225 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-40850b57-8b7c-4975-98d2-5b95cac46edb tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:40.345827 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3dd36bba-1de1-443f-b9bc-687cfdb7708d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:40.346743 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3dd36bba-1de1-443f-b9bc-687cfdb7708d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:40.347335 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3dd36bba-1de1-443f-b9bc-687cfdb7708d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:40.348755 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3dd36bba-1de1-443f-b9bc-687cfdb7708d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:40.349464 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3dd36bba-1de1-443f-b9bc-687cfdb7708d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:40.350055 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3dd36bba-1de1-443f-b9bc-687cfdb7708d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:40.351385 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-40850b57-8b7c-4975-98d2-5b95cac46edb tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:40.352740 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-40850b57-8b7c-4975-98d2-5b95cac46edb tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:40.356949 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-40850b57-8b7c-4975-98d2-5b95cac46edb tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1809 microversion: 2.20 time: 0.193430 Nov 02 14:42:40.369975 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 213/448] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:42:40 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1809 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:42:40.787271 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-3dd36bba-1de1-443f-b9bc-687cfdb7708d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:40.795446 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-3dd36bba-1de1-443f-b9bc-687cfdb7708d tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff" status: 200 len: 1501 microversion: 2.1 time: 0.469308 Nov 02 14:42:40.796058 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 236/449] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:40 2022] GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff => generated 1501 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:41.166777 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-08e572db-8a07-4eb8-bf8a-f68c8ef4fef3 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:41.167410 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-08e572db-8a07-4eb8-bf8a-f68c8ef4fef3 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] [instance: 42424cc7-8d64-4aac-8fb8-405b40f5b526] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:41.175511 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-08e572db-8a07-4eb8-bf8a-f68c8ef4fef3 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:41.176003 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-08e572db-8a07-4eb8-bf8a-f68c8ef4fef3 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:41.176446 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-08e572db-8a07-4eb8-bf8a-f68c8ef4fef3 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:41.177192 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-08e572db-8a07-4eb8-bf8a-f68c8ef4fef3 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:41.177652 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-08e572db-8a07-4eb8-bf8a-f68c8ef4fef3 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:41.178078 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-08e572db-8a07-4eb8-bf8a-f68c8ef4fef3 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:41.312911 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-08e572db-8a07-4eb8-bf8a-f68c8ef4fef3 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa6a7aba33d4abd9389ecd2e3fa0906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e090451c7e4296a0b85c7eeb9002f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:41.321295 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-08e572db-8a07-4eb8-bf8a-f68c8ef4fef3 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] 10.222.0.30 "GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526" status: 200 len: 1314 microversion: 2.1 time: 0.158264 Nov 02 14:42:41.321873 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 214/450] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:41 2022] GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:42:41.398644 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-35eec6c2-c174-492f-a575-5ab93d0eedb6 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:41.399323 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-35eec6c2-c174-492f-a575-5ab93d0eedb6 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:41.409386 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-35eec6c2-c174-492f-a575-5ab93d0eedb6 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:41.409990 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-35eec6c2-c174-492f-a575-5ab93d0eedb6 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:41.410513 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-35eec6c2-c174-492f-a575-5ab93d0eedb6 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:41.411309 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-35eec6c2-c174-492f-a575-5ab93d0eedb6 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:41.411866 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-35eec6c2-c174-492f-a575-5ab93d0eedb6 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:41.412430 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-35eec6c2-c174-492f-a575-5ab93d0eedb6 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:41.588661 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-35eec6c2-c174-492f-a575-5ab93d0eedb6 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:41.598003 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-35eec6c2-c174-492f-a575-5ab93d0eedb6 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:41.600656 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-35eec6c2-c174-492f-a575-5ab93d0eedb6 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:41.600805 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-35eec6c2-c174-492f-a575-5ab93d0eedb6 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1809 microversion: 2.20 time: 0.206300 Nov 02 14:42:41.601640 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 237/451] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:42:41 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1809 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:42:41.820519 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-e99e10e8-d573-4a38-94ed-cb0c66f983f0 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:41.821157 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-e99e10e8-d573-4a38-94ed-cb0c66f983f0 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: bd91069f-ef45-44b0-a9c8-022d089d2dff] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:41.827272 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e99e10e8-d573-4a38-94ed-cb0c66f983f0 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:41.827754 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e99e10e8-d573-4a38-94ed-cb0c66f983f0 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:41.828187 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e99e10e8-d573-4a38-94ed-cb0c66f983f0 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:41.828912 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e99e10e8-d573-4a38-94ed-cb0c66f983f0 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:41.829430 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e99e10e8-d573-4a38-94ed-cb0c66f983f0 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:41.829906 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e99e10e8-d573-4a38-94ed-cb0c66f983f0 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:41.965541 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-e99e10e8-d573-4a38-94ed-cb0c66f983f0 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:41.973357 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-e99e10e8-d573-4a38-94ed-cb0c66f983f0 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff" status: 200 len: 1501 microversion: 2.1 time: 0.156700 Nov 02 14:42:41.973924 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 215/452] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:41 2022] GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff => generated 1501 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:42.343842 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-e03cafd5-f29f-4ff7-8278-814562ff894b tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:42.344936 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-e03cafd5-f29f-4ff7-8278-814562ff894b tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] [instance: 42424cc7-8d64-4aac-8fb8-405b40f5b526] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:42.351051 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e03cafd5-f29f-4ff7-8278-814562ff894b tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:42.351528 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e03cafd5-f29f-4ff7-8278-814562ff894b tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:42.351960 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e03cafd5-f29f-4ff7-8278-814562ff894b tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:42.352643 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e03cafd5-f29f-4ff7-8278-814562ff894b tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:42.353117 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e03cafd5-f29f-4ff7-8278-814562ff894b tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:42.353540 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e03cafd5-f29f-4ff7-8278-814562ff894b tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:42.485952 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-e03cafd5-f29f-4ff7-8278-814562ff894b tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa6a7aba33d4abd9389ecd2e3fa0906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e090451c7e4296a0b85c7eeb9002f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:42.493696 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-e03cafd5-f29f-4ff7-8278-814562ff894b tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] 10.222.0.30 "GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526" status: 200 len: 1314 microversion: 2.1 time: 0.153815 Nov 02 14:42:42.494263 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 238/453] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:42 2022] GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:42.626699 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-7a71b5dc-6f34-45cd-a097-96646912bc57 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:42.627351 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-7a71b5dc-6f34-45cd-a097-96646912bc57 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:42.633236 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7a71b5dc-6f34-45cd-a097-96646912bc57 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:42.634162 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7a71b5dc-6f34-45cd-a097-96646912bc57 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:42.634609 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7a71b5dc-6f34-45cd-a097-96646912bc57 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:42.635304 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7a71b5dc-6f34-45cd-a097-96646912bc57 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:42.635758 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7a71b5dc-6f34-45cd-a097-96646912bc57 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:42.636204 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7a71b5dc-6f34-45cd-a097-96646912bc57 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:42.656377 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell1:SELECT=100 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:42:42.767387 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-7a71b5dc-6f34-45cd-a097-96646912bc57 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:42.776103 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-7a71b5dc-6f34-45cd-a097-96646912bc57 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:42.777587 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-7a71b5dc-6f34-45cd-a097-96646912bc57 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:42.778746 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-7a71b5dc-6f34-45cd-a097-96646912bc57 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1809 microversion: 2.20 time: 0.156091 Nov 02 14:42:42.779307 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 216/454] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:42:42 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:42:42.997378 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-e0b1b16f-2386-4fe8-8a0b-b01b8b99fb7a tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:42.997985 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-e0b1b16f-2386-4fe8-8a0b-b01b8b99fb7a tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: bd91069f-ef45-44b0-a9c8-022d089d2dff] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:43.004570 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e0b1b16f-2386-4fe8-8a0b-b01b8b99fb7a tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:43.005089 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e0b1b16f-2386-4fe8-8a0b-b01b8b99fb7a tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:43.005530 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e0b1b16f-2386-4fe8-8a0b-b01b8b99fb7a tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:43.006263 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e0b1b16f-2386-4fe8-8a0b-b01b8b99fb7a tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:43.006792 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e0b1b16f-2386-4fe8-8a0b-b01b8b99fb7a tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:43.007217 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e0b1b16f-2386-4fe8-8a0b-b01b8b99fb7a tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:43.147539 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-e0b1b16f-2386-4fe8-8a0b-b01b8b99fb7a tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:43.156643 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-e0b1b16f-2386-4fe8-8a0b-b01b8b99fb7a tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff" status: 200 len: 1501 microversion: 2.1 time: 0.163120 Nov 02 14:42:43.157251 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 239/455] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:42 2022] GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff => generated 1501 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:43.516952 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-ca1c6bb9-e4fe-46b6-85e5-35f43851f012 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:43.521788 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-ca1c6bb9-e4fe-46b6-85e5-35f43851f012 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] [instance: 42424cc7-8d64-4aac-8fb8-405b40f5b526] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:43.523494 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ca1c6bb9-e4fe-46b6-85e5-35f43851f012 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:43.523974 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ca1c6bb9-e4fe-46b6-85e5-35f43851f012 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:43.524423 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ca1c6bb9-e4fe-46b6-85e5-35f43851f012 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:43.525127 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ca1c6bb9-e4fe-46b6-85e5-35f43851f012 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:43.525582 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ca1c6bb9-e4fe-46b6-85e5-35f43851f012 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:43.526025 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ca1c6bb9-e4fe-46b6-85e5-35f43851f012 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:43.659174 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-ca1c6bb9-e4fe-46b6-85e5-35f43851f012 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa6a7aba33d4abd9389ecd2e3fa0906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e090451c7e4296a0b85c7eeb9002f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:43.667340 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-ca1c6bb9-e4fe-46b6-85e5-35f43851f012 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] 10.222.0.30 "GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526" status: 200 len: 1314 microversion: 2.1 time: 0.154763 Nov 02 14:42:43.668016 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 217/456] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:43 2022] GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:43.804769 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-b69ea1f7-b9bd-40e9-b7d9-c69fc89a3b99 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:43.805401 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-b69ea1f7-b9bd-40e9-b7d9-c69fc89a3b99 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:43.811818 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b69ea1f7-b9bd-40e9-b7d9-c69fc89a3b99 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:43.812275 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b69ea1f7-b9bd-40e9-b7d9-c69fc89a3b99 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:43.812702 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b69ea1f7-b9bd-40e9-b7d9-c69fc89a3b99 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:43.813508 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b69ea1f7-b9bd-40e9-b7d9-c69fc89a3b99 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:43.813949 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b69ea1f7-b9bd-40e9-b7d9-c69fc89a3b99 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:43.814366 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b69ea1f7-b9bd-40e9-b7d9-c69fc89a3b99 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:43.955909 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-b69ea1f7-b9bd-40e9-b7d9-c69fc89a3b99 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:43.964797 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-b69ea1f7-b9bd-40e9-b7d9-c69fc89a3b99 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:43.966276 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-b69ea1f7-b9bd-40e9-b7d9-c69fc89a3b99 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:43.967422 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-b69ea1f7-b9bd-40e9-b7d9-c69fc89a3b99 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1809 microversion: 2.20 time: 0.166552 Nov 02 14:42:43.968066 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 240/457] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:42:43 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:42:44.181039 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-604d3ed9-c75d-43ce-ae38-79a7c4f45538 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:44.181571 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-604d3ed9-c75d-43ce-ae38-79a7c4f45538 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: bd91069f-ef45-44b0-a9c8-022d089d2dff] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:44.187513 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-604d3ed9-c75d-43ce-ae38-79a7c4f45538 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:44.189854 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-604d3ed9-c75d-43ce-ae38-79a7c4f45538 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:44.189854 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-604d3ed9-c75d-43ce-ae38-79a7c4f45538 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:44.189854 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-604d3ed9-c75d-43ce-ae38-79a7c4f45538 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:44.190115 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-604d3ed9-c75d-43ce-ae38-79a7c4f45538 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:44.190508 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-604d3ed9-c75d-43ce-ae38-79a7c4f45538 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:44.320191 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-604d3ed9-c75d-43ce-ae38-79a7c4f45538 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:44.327985 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-604d3ed9-c75d-43ce-ae38-79a7c4f45538 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff" status: 200 len: 1501 microversion: 2.1 time: 0.150927 Nov 02 14:42:44.328556 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 218/458] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:44 2022] GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff => generated 1501 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:44.691914 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-19a4ee0d-cbce-4f7f-9279-00f6f6864ecd tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:44.692596 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-19a4ee0d-cbce-4f7f-9279-00f6f6864ecd tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] [instance: 42424cc7-8d64-4aac-8fb8-405b40f5b526] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:44.698805 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-19a4ee0d-cbce-4f7f-9279-00f6f6864ecd tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:44.699392 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-19a4ee0d-cbce-4f7f-9279-00f6f6864ecd tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:44.699896 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-19a4ee0d-cbce-4f7f-9279-00f6f6864ecd tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:44.700725 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-19a4ee0d-cbce-4f7f-9279-00f6f6864ecd tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:44.701277 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-19a4ee0d-cbce-4f7f-9279-00f6f6864ecd tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:44.704974 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-19a4ee0d-cbce-4f7f-9279-00f6f6864ecd tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:44.710429 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:42:44.849954 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-19a4ee0d-cbce-4f7f-9279-00f6f6864ecd tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa6a7aba33d4abd9389ecd2e3fa0906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e090451c7e4296a0b85c7eeb9002f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:44.859122 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-19a4ee0d-cbce-4f7f-9279-00f6f6864ecd tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] 10.222.0.30 "GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526" status: 200 len: 1314 microversion: 2.1 time: 0.171962 Nov 02 14:42:44.859706 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 241/459] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:44 2022] GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:42:44.994996 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-9d8c794d-dad0-44f9-b308-848c50ea3bf8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:44.995534 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-9d8c794d-dad0-44f9-b308-848c50ea3bf8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:45.002303 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9d8c794d-dad0-44f9-b308-848c50ea3bf8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:45.002787 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9d8c794d-dad0-44f9-b308-848c50ea3bf8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:45.003219 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9d8c794d-dad0-44f9-b308-848c50ea3bf8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:45.004397 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9d8c794d-dad0-44f9-b308-848c50ea3bf8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:45.004397 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9d8c794d-dad0-44f9-b308-848c50ea3bf8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:45.004759 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9d8c794d-dad0-44f9-b308-848c50ea3bf8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:45.141697 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-9d8c794d-dad0-44f9-b308-848c50ea3bf8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:45.166367 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-9d8c794d-dad0-44f9-b308-848c50ea3bf8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:45.168247 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-9d8c794d-dad0-44f9-b308-848c50ea3bf8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:45.169654 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-9d8c794d-dad0-44f9-b308-848c50ea3bf8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1809 microversion: 2.20 time: 0.178626 Nov 02 14:42:45.170518 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 219/460] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:42:44 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:42:45.351365 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-6d443bed-cdf6-4fb1-90af-686023b32d36 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:45.352193 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-6d443bed-cdf6-4fb1-90af-686023b32d36 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: bd91069f-ef45-44b0-a9c8-022d089d2dff] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:45.359191 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6d443bed-cdf6-4fb1-90af-686023b32d36 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:45.359666 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6d443bed-cdf6-4fb1-90af-686023b32d36 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:45.360589 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6d443bed-cdf6-4fb1-90af-686023b32d36 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:45.361355 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6d443bed-cdf6-4fb1-90af-686023b32d36 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:45.361830 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6d443bed-cdf6-4fb1-90af-686023b32d36 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:45.362251 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6d443bed-cdf6-4fb1-90af-686023b32d36 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:45.505371 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-6d443bed-cdf6-4fb1-90af-686023b32d36 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:45.516119 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-6d443bed-cdf6-4fb1-90af-686023b32d36 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff" status: 200 len: 1501 microversion: 2.1 time: 0.166054 Nov 02 14:42:45.516119 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 242/461] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:45 2022] GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff => generated 1501 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:45.753080 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [req-5b53189b-0b6c-4b1c-b56e-8b3a33530c08 req-40181f3c-9395-47cc-a075-3a2190bacd9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd91069f-ef45-44b0-a9c8-022d089d2dff", "name": "network-vif-deleted", "tag": "bdeedfb0-c94b-4193-9d25-ca0bb97dc80d"}]} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:42:45.766313 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-5b53189b-0b6c-4b1c-b56e-8b3a33530c08 req-40181f3c-9395-47cc-a075-3a2190bacd9e service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:45.766313 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-5b53189b-0b6c-4b1c-b56e-8b3a33530c08 req-40181f3c-9395-47cc-a075-3a2190bacd9e service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:45.766313 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-5b53189b-0b6c-4b1c-b56e-8b3a33530c08 req-40181f3c-9395-47cc-a075-3a2190bacd9e service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:45.777678 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.compute.server_external_events [req-5b53189b-0b6c-4b1c-b56e-8b3a33530c08 req-40181f3c-9395-47cc-a075-3a2190bacd9e service nova] Creating event network-vif-deleted:bdeedfb0-c94b-4193-9d25-ca0bb97dc80d for instance bd91069f-ef45-44b0-a9c8-022d089d2dff on hv-cinder-86236 Nov 02 14:42:45.783235 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [req-5b53189b-0b6c-4b1c-b56e-8b3a33530c08 req-40181f3c-9395-47cc-a075-3a2190bacd9e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035353 Nov 02 14:42:45.783839 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 220/462] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:42:45.881915 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-9e28b909-cf1b-481f-aae7-76f246d2f53e tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:45.882500 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-9e28b909-cf1b-481f-aae7-76f246d2f53e tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] [instance: 42424cc7-8d64-4aac-8fb8-405b40f5b526] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:45.889279 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9e28b909-cf1b-481f-aae7-76f246d2f53e tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:45.889776 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9e28b909-cf1b-481f-aae7-76f246d2f53e tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:45.890206 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9e28b909-cf1b-481f-aae7-76f246d2f53e tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:45.890904 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9e28b909-cf1b-481f-aae7-76f246d2f53e tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:45.891599 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9e28b909-cf1b-481f-aae7-76f246d2f53e tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:45.892045 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9e28b909-cf1b-481f-aae7-76f246d2f53e tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:45.974802 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-a302aad5-ed94-4ec5-95b0-38d3f0d9474e tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:45.975688 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-a302aad5-ed94-4ec5-95b0-38d3f0d9474e tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:45.983175 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a302aad5-ed94-4ec5-95b0-38d3f0d9474e tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:45.983730 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a302aad5-ed94-4ec5-95b0-38d3f0d9474e tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:45.984228 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a302aad5-ed94-4ec5-95b0-38d3f0d9474e tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:45.984984 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a302aad5-ed94-4ec5-95b0-38d3f0d9474e tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:45.985677 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a302aad5-ed94-4ec5-95b0-38d3f0d9474e tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:45.986452 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a302aad5-ed94-4ec5-95b0-38d3f0d9474e tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:46.062921 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-9e28b909-cf1b-481f-aae7-76f246d2f53e tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa6a7aba33d4abd9389ecd2e3fa0906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e090451c7e4296a0b85c7eeb9002f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:46.071237 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-9e28b909-cf1b-481f-aae7-76f246d2f53e tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] 10.222.0.30 "GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526" status: 200 len: 1314 microversion: 2.1 time: 0.193141 Nov 02 14:42:46.071994 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 243/463] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:45 2022] GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:46.143832 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-a302aad5-ed94-4ec5-95b0-38d3f0d9474e tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cc06a6df04ca4ab453de57ee84279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60a52ce75b94198ac6abb7727e7072d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:46.156597 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-a302aad5-ed94-4ec5-95b0-38d3f0d9474e tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7" status: 200 len: 1594 microversion: 2.1 time: 0.187671 Nov 02 14:42:46.158115 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 221/464] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:45 2022] GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7 => generated 1594 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:46.195814 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-9031866a-3a9f-4004-919c-495e580c19d4 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:46.196424 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-9031866a-3a9f-4004-919c-495e580c19d4 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:46.203020 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9031866a-3a9f-4004-919c-495e580c19d4 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:46.203020 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9031866a-3a9f-4004-919c-495e580c19d4 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:46.205839 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9031866a-3a9f-4004-919c-495e580c19d4 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:46.206589 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9031866a-3a9f-4004-919c-495e580c19d4 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:46.207056 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9031866a-3a9f-4004-919c-495e580c19d4 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:46.207487 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9031866a-3a9f-4004-919c-495e580c19d4 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:46.353957 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-9031866a-3a9f-4004-919c-495e580c19d4 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:46.363521 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-9031866a-3a9f-4004-919c-495e580c19d4 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:46.364963 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-9031866a-3a9f-4004-919c-495e580c19d4 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:46.366171 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-9031866a-3a9f-4004-919c-495e580c19d4 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1809 microversion: 2.20 time: 0.174660 Nov 02 14:42:46.366715 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 244/465] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:42:46 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:42:46.546265 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-835c5ae7-8fc8-41ff-9c7b-53377cba0a40 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:46.546265 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-835c5ae7-8fc8-41ff-9c7b-53377cba0a40 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: bd91069f-ef45-44b0-a9c8-022d089d2dff] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:46.556379 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-835c5ae7-8fc8-41ff-9c7b-53377cba0a40 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:46.557197 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-835c5ae7-8fc8-41ff-9c7b-53377cba0a40 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:46.557748 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-835c5ae7-8fc8-41ff-9c7b-53377cba0a40 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:46.558646 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-835c5ae7-8fc8-41ff-9c7b-53377cba0a40 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:46.559231 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-835c5ae7-8fc8-41ff-9c7b-53377cba0a40 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:46.559802 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-835c5ae7-8fc8-41ff-9c7b-53377cba0a40 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:46.645795 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-835c5ae7-8fc8-41ff-9c7b-53377cba0a40 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:46.653582 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-835c5ae7-8fc8-41ff-9c7b-53377cba0a40 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff" status: 200 len: 1297 microversion: 2.1 time: 0.118757 Nov 02 14:42:46.654329 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 222/466] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:46 2022] GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff => generated 1297 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:42:47.096340 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-b86c85be-769d-4b9f-8859-95a3e0160555 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:47.097109 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-b86c85be-769d-4b9f-8859-95a3e0160555 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] [instance: 42424cc7-8d64-4aac-8fb8-405b40f5b526] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:47.105728 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b86c85be-769d-4b9f-8859-95a3e0160555 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:47.106214 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b86c85be-769d-4b9f-8859-95a3e0160555 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:47.106874 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b86c85be-769d-4b9f-8859-95a3e0160555 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:47.107856 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b86c85be-769d-4b9f-8859-95a3e0160555 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:47.109175 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b86c85be-769d-4b9f-8859-95a3e0160555 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:47.109607 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b86c85be-769d-4b9f-8859-95a3e0160555 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:47.347712 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-b86c85be-769d-4b9f-8859-95a3e0160555 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa6a7aba33d4abd9389ecd2e3fa0906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e090451c7e4296a0b85c7eeb9002f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:47.356072 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-b86c85be-769d-4b9f-8859-95a3e0160555 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] 10.222.0.30 "GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526" status: 200 len: 1464 microversion: 2.1 time: 0.264362 Nov 02 14:42:47.356976 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 245/467] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:47 2022] GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526 => generated 1464 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:47.393081 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-156dc13a-01d9-49ea-beac-2080134c8313 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:47.393846 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-156dc13a-01d9-49ea-beac-2080134c8313 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:47.400843 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-156dc13a-01d9-49ea-beac-2080134c8313 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:47.401489 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-156dc13a-01d9-49ea-beac-2080134c8313 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:47.402273 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-156dc13a-01d9-49ea-beac-2080134c8313 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:47.403042 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-156dc13a-01d9-49ea-beac-2080134c8313 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:47.403508 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-156dc13a-01d9-49ea-beac-2080134c8313 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:47.403944 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-156dc13a-01d9-49ea-beac-2080134c8313 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:47.410313 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-dba02387-8108-4a17-b0b5-067ac472cfcf tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:47.411099 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-dba02387-8108-4a17-b0b5-067ac472cfcf tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] [instance: 42424cc7-8d64-4aac-8fb8-405b40f5b526] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:47.418036 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-dba02387-8108-4a17-b0b5-067ac472cfcf tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:47.418947 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-dba02387-8108-4a17-b0b5-067ac472cfcf tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:47.419576 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-dba02387-8108-4a17-b0b5-067ac472cfcf tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:47.420520 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-dba02387-8108-4a17-b0b5-067ac472cfcf tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:47.421208 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-dba02387-8108-4a17-b0b5-067ac472cfcf tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:47.421695 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-dba02387-8108-4a17-b0b5-067ac472cfcf tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:47.451365 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-dba02387-8108-4a17-b0b5-067ac472cfcf tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] [instance: 42424cc7-8d64-4aac-8fb8-405b40f5b526] Going to try to terminate instance {{(pid=119659) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:42:47.614474 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-156dc13a-01d9-49ea-beac-2080134c8313 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:47.624073 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-156dc13a-01d9-49ea-beac-2080134c8313 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:47.628213 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-156dc13a-01d9-49ea-beac-2080134c8313 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:47.629517 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-156dc13a-01d9-49ea-beac-2080134c8313 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1809 microversion: 2.20 time: 0.241590 Nov 02 14:42:47.630085 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 223/468] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:42:47 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1809 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:42:47.679666 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-b682fb1a-4189-4be5-9fac-6996b5d5b404 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:47.681072 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-b682fb1a-4189-4be5-9fac-6996b5d5b404 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: bd91069f-ef45-44b0-a9c8-022d089d2dff] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:47.693114 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b682fb1a-4189-4be5-9fac-6996b5d5b404 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:47.693114 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b682fb1a-4189-4be5-9fac-6996b5d5b404 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:47.693114 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b682fb1a-4189-4be5-9fac-6996b5d5b404 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:47.693114 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b682fb1a-4189-4be5-9fac-6996b5d5b404 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:47.693464 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b682fb1a-4189-4be5-9fac-6996b5d5b404 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:47.694128 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b682fb1a-4189-4be5-9fac-6996b5d5b404 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:47.732663 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b682fb1a-4189-4be5-9fac-6996b5d5b404 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:47.733600 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b682fb1a-4189-4be5-9fac-6996b5d5b404 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:47.734033 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b682fb1a-4189-4be5-9fac-6996b5d5b404 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:47.734478 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.objects.instance [None req-b682fb1a-4189-4be5-9fac-6996b5d5b404 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lazy-loading 'fault' on Instance uuid bd91069f-ef45-44b0-a9c8-022d089d2dff {{(pid=119658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:42:47.793330 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-b682fb1a-4189-4be5-9fac-6996b5d5b404 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:47.801646 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-b682fb1a-4189-4be5-9fac-6996b5d5b404 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff" status: 200 len: 1302 microversion: 2.1 time: 0.127842 Nov 02 14:42:47.802208 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 224/469] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:47 2022] GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff => generated 1302 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:42:47.855109 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-dba02387-8108-4a17-b0b5-067ac472cfcf tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] 10.222.0.30 "DELETE /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526" status: 204 len: 0 microversion: 2.1 time: 0.448871 Nov 02 14:42:47.855726 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 246/470] 10.222.0.30 () {58 vars in 1239 bytes} [Wed Nov 2 14:42:47 2022] DELETE /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 14:42:47.867490 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-ce0ecf79-7dfb-4677-aec1-d1a27f3ae9e7 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:47.868323 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-ce0ecf79-7dfb-4677-aec1-d1a27f3ae9e7 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] [instance: 42424cc7-8d64-4aac-8fb8-405b40f5b526] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:47.874379 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ce0ecf79-7dfb-4677-aec1-d1a27f3ae9e7 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:47.874871 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ce0ecf79-7dfb-4677-aec1-d1a27f3ae9e7 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:47.875568 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ce0ecf79-7dfb-4677-aec1-d1a27f3ae9e7 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:47.877137 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ce0ecf79-7dfb-4677-aec1-d1a27f3ae9e7 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:47.877620 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ce0ecf79-7dfb-4677-aec1-d1a27f3ae9e7 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:47.881072 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ce0ecf79-7dfb-4677-aec1-d1a27f3ae9e7 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:48.098819 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-ce0ecf79-7dfb-4677-aec1-d1a27f3ae9e7 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa6a7aba33d4abd9389ecd2e3fa0906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e090451c7e4296a0b85c7eeb9002f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:48.110176 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-ce0ecf79-7dfb-4677-aec1-d1a27f3ae9e7 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] 10.222.0.30 "GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526" status: 200 len: 1470 microversion: 2.1 time: 0.246305 Nov 02 14:42:48.111542 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 225/471] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:47 2022] GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526 => generated 1470 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:48.636967 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [req-dba54b7d-e7b5-406f-8b65-1a0753624f27 req-20ffd4fd-b1fe-4aa4-97d0-f72b33500845 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24d10c5a-012e-4d8a-8188-c2289e1605b7", "tag": "881c5e7e-3ed6-4eda-ba12-f2fc35e98f97"}]} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:42:48.647762 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-dba54b7d-e7b5-406f-8b65-1a0753624f27 req-20ffd4fd-b1fe-4aa4-97d0-f72b33500845 service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:48.648350 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-dba54b7d-e7b5-406f-8b65-1a0753624f27 req-20ffd4fd-b1fe-4aa4-97d0-f72b33500845 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:48.650149 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-dba54b7d-e7b5-406f-8b65-1a0753624f27 req-20ffd4fd-b1fe-4aa4-97d0-f72b33500845 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:48.655923 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-05c7ab5b-6e00-47ed-a754-d9268b82f62c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:48.657319 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-05c7ab5b-6e00-47ed-a754-d9268b82f62c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:48.664553 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.compute.server_external_events [req-dba54b7d-e7b5-406f-8b65-1a0753624f27 req-20ffd4fd-b1fe-4aa4-97d0-f72b33500845 service nova] Creating event network-changed:881c5e7e-3ed6-4eda-ba12-f2fc35e98f97 for instance 24d10c5a-012e-4d8a-8188-c2289e1605b7 on hv-cinder-86236 Nov 02 14:42:48.669614 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-05c7ab5b-6e00-47ed-a754-d9268b82f62c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:48.670398 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-05c7ab5b-6e00-47ed-a754-d9268b82f62c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:48.670692 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [req-dba54b7d-e7b5-406f-8b65-1a0753624f27 req-20ffd4fd-b1fe-4aa4-97d0-f72b33500845 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038018 Nov 02 14:42:48.670921 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-05c7ab5b-6e00-47ed-a754-d9268b82f62c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:48.671555 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 247/472] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:42:48.671678 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-05c7ab5b-6e00-47ed-a754-d9268b82f62c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:48.672081 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-05c7ab5b-6e00-47ed-a754-d9268b82f62c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:48.674914 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-05c7ab5b-6e00-47ed-a754-d9268b82f62c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:48.827208 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-6f18dc4e-31b4-4544-900e-5a98a77d96b3 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:48.828025 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-6f18dc4e-31b4-4544-900e-5a98a77d96b3 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: bd91069f-ef45-44b0-a9c8-022d089d2dff] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:48.840527 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6f18dc4e-31b4-4544-900e-5a98a77d96b3 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:48.841594 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6f18dc4e-31b4-4544-900e-5a98a77d96b3 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:48.846483 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6f18dc4e-31b4-4544-900e-5a98a77d96b3 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:48.847253 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6f18dc4e-31b4-4544-900e-5a98a77d96b3 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:48.847729 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6f18dc4e-31b4-4544-900e-5a98a77d96b3 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:48.848260 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6f18dc4e-31b4-4544-900e-5a98a77d96b3 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:48.868588 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-05c7ab5b-6e00-47ed-a754-d9268b82f62c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:48.880076 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-05c7ab5b-6e00-47ed-a754-d9268b82f62c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:48.881930 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-05c7ab5b-6e00-47ed-a754-d9268b82f62c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:48.883244 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-05c7ab5b-6e00-47ed-a754-d9268b82f62c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1809 microversion: 2.20 time: 0.231448 Nov 02 14:42:48.883804 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 226/473] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:42:48 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1809 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:42:48.894092 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6f18dc4e-31b4-4544-900e-5a98a77d96b3 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:48.894581 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6f18dc4e-31b4-4544-900e-5a98a77d96b3 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:48.895020 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6f18dc4e-31b4-4544-900e-5a98a77d96b3 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:48.895474 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.objects.instance [None req-6f18dc4e-31b4-4544-900e-5a98a77d96b3 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lazy-loading 'fault' on Instance uuid bd91069f-ef45-44b0-a9c8-022d089d2dff {{(pid=119659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:42:48.939739 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-6f18dc4e-31b4-4544-900e-5a98a77d96b3 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:48.947900 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-6f18dc4e-31b4-4544-900e-5a98a77d96b3 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff" status: 200 len: 1302 microversion: 2.1 time: 0.125326 Nov 02 14:42:48.948479 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 248/474] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:48 2022] GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff => generated 1302 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:49.135930 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-67dfc79e-0d1b-4277-9e23-0402f9bf3c2b tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:49.136566 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-67dfc79e-0d1b-4277-9e23-0402f9bf3c2b tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] [instance: 42424cc7-8d64-4aac-8fb8-405b40f5b526] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:49.143396 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-67dfc79e-0d1b-4277-9e23-0402f9bf3c2b tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:49.143898 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-67dfc79e-0d1b-4277-9e23-0402f9bf3c2b tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:49.144545 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-67dfc79e-0d1b-4277-9e23-0402f9bf3c2b tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:49.145373 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-67dfc79e-0d1b-4277-9e23-0402f9bf3c2b tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:49.145837 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-67dfc79e-0d1b-4277-9e23-0402f9bf3c2b tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:49.146271 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-67dfc79e-0d1b-4277-9e23-0402f9bf3c2b tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:49.287104 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-67dfc79e-0d1b-4277-9e23-0402f9bf3c2b tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa6a7aba33d4abd9389ecd2e3fa0906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e090451c7e4296a0b85c7eeb9002f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:49.296909 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-67dfc79e-0d1b-4277-9e23-0402f9bf3c2b tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] 10.222.0.30 "GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526" status: 200 len: 1470 microversion: 2.1 time: 0.165122 Nov 02 14:42:49.298729 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 227/475] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:49 2022] GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526 => generated 1470 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:49.913860 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-7312efe8-9938-4768-801d-956ec3696a34 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:49.916141 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-7312efe8-9938-4768-801d-956ec3696a34 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:49.924591 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7312efe8-9938-4768-801d-956ec3696a34 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:49.925208 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7312efe8-9938-4768-801d-956ec3696a34 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:49.925848 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7312efe8-9938-4768-801d-956ec3696a34 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:49.926551 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7312efe8-9938-4768-801d-956ec3696a34 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:49.926999 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7312efe8-9938-4768-801d-956ec3696a34 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:49.927419 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7312efe8-9938-4768-801d-956ec3696a34 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:49.971081 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-bb910c16-ce05-421a-b3b8-5440f32a5de4 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:49.971722 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-bb910c16-ce05-421a-b3b8-5440f32a5de4 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: bd91069f-ef45-44b0-a9c8-022d089d2dff] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:49.978730 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-bb910c16-ce05-421a-b3b8-5440f32a5de4 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:49.979876 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-bb910c16-ce05-421a-b3b8-5440f32a5de4 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:49.980696 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-bb910c16-ce05-421a-b3b8-5440f32a5de4 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:49.981732 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-bb910c16-ce05-421a-b3b8-5440f32a5de4 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:49.982266 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-bb910c16-ce05-421a-b3b8-5440f32a5de4 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:49.982830 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-bb910c16-ce05-421a-b3b8-5440f32a5de4 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:50.017261 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-bb910c16-ce05-421a-b3b8-5440f32a5de4 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:50.017856 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-bb910c16-ce05-421a-b3b8-5440f32a5de4 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:50.018400 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-bb910c16-ce05-421a-b3b8-5440f32a5de4 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:50.018860 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.objects.instance [None req-bb910c16-ce05-421a-b3b8-5440f32a5de4 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lazy-loading 'fault' on Instance uuid bd91069f-ef45-44b0-a9c8-022d089d2dff {{(pid=119658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:42:50.071427 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-bb910c16-ce05-421a-b3b8-5440f32a5de4 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:50.080960 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-bb910c16-ce05-421a-b3b8-5440f32a5de4 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff" status: 200 len: 1302 microversion: 2.1 time: 0.113852 Nov 02 14:42:50.081953 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 228/476] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:49 2022] GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff => generated 1302 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:42:50.133514 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-7312efe8-9938-4768-801d-956ec3696a34 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:50.142496 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-7312efe8-9938-4768-801d-956ec3696a34 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:50.143926 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-7312efe8-9938-4768-801d-956ec3696a34 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:50.145129 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-7312efe8-9938-4768-801d-956ec3696a34 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1809 microversion: 2.20 time: 0.236140 Nov 02 14:42:50.145721 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 249/477] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:42:49 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1809 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:42:50.322365 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-2b5ef635-ece2-4f11-9c20-5f2ac0a4c699 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:50.323096 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-2b5ef635-ece2-4f11-9c20-5f2ac0a4c699 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] [instance: 42424cc7-8d64-4aac-8fb8-405b40f5b526] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:50.330237 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2b5ef635-ece2-4f11-9c20-5f2ac0a4c699 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:50.330957 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2b5ef635-ece2-4f11-9c20-5f2ac0a4c699 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:50.331414 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2b5ef635-ece2-4f11-9c20-5f2ac0a4c699 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:50.332157 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2b5ef635-ece2-4f11-9c20-5f2ac0a4c699 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:50.332619 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2b5ef635-ece2-4f11-9c20-5f2ac0a4c699 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:50.333064 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2b5ef635-ece2-4f11-9c20-5f2ac0a4c699 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:50.471850 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-2b5ef635-ece2-4f11-9c20-5f2ac0a4c699 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa6a7aba33d4abd9389ecd2e3fa0906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e090451c7e4296a0b85c7eeb9002f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:50.479749 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-2b5ef635-ece2-4f11-9c20-5f2ac0a4c699 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] 10.222.0.30 "GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526" status: 200 len: 1470 microversion: 2.1 time: 0.162664 Nov 02 14:42:50.480319 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 229/478] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:50 2022] GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526 => generated 1470 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:51.105869 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-6a3bad9e-5c44-4964-bc5b-ce9b196b2b4a tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:51.106558 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-6a3bad9e-5c44-4964-bc5b-ce9b196b2b4a tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: bd91069f-ef45-44b0-a9c8-022d089d2dff] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:51.124642 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6a3bad9e-5c44-4964-bc5b-ce9b196b2b4a tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:51.129144 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6a3bad9e-5c44-4964-bc5b-ce9b196b2b4a tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:51.130120 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6a3bad9e-5c44-4964-bc5b-ce9b196b2b4a tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:51.131133 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6a3bad9e-5c44-4964-bc5b-ce9b196b2b4a tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:51.131827 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6a3bad9e-5c44-4964-bc5b-ce9b196b2b4a tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:51.132461 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6a3bad9e-5c44-4964-bc5b-ce9b196b2b4a tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:51.170986 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-baf36413-54af-4930-8da4-6422c661c7e8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:51.171604 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-baf36413-54af-4930-8da4-6422c661c7e8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:51.175911 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6a3bad9e-5c44-4964-bc5b-ce9b196b2b4a tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:51.176676 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6a3bad9e-5c44-4964-bc5b-ce9b196b2b4a tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:51.177545 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6a3bad9e-5c44-4964-bc5b-ce9b196b2b4a tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:51.178176 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.objects.instance [None req-6a3bad9e-5c44-4964-bc5b-ce9b196b2b4a tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lazy-loading 'fault' on Instance uuid bd91069f-ef45-44b0-a9c8-022d089d2dff {{(pid=119659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:42:51.181720 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-baf36413-54af-4930-8da4-6422c661c7e8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:51.183863 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-baf36413-54af-4930-8da4-6422c661c7e8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:51.184508 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-baf36413-54af-4930-8da4-6422c661c7e8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:51.186299 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-baf36413-54af-4930-8da4-6422c661c7e8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:51.189207 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-baf36413-54af-4930-8da4-6422c661c7e8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:51.191823 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-baf36413-54af-4930-8da4-6422c661c7e8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:51.458432 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-6a3bad9e-5c44-4964-bc5b-ce9b196b2b4a tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51fbcb1f2714d2c825266ec673348a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b8cf11e60741e29dfec5f97c462eff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:51.472474 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-6a3bad9e-5c44-4964-bc5b-ce9b196b2b4a tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff" status: 200 len: 1302 microversion: 2.1 time: 0.372415 Nov 02 14:42:51.488383 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 250/479] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:51 2022] GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff => generated 1302 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:51.509594 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-7548d979-0622-4041-913b-8c356aa4fe17 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:51.511361 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-7548d979-0622-4041-913b-8c356aa4fe17 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] [instance: 42424cc7-8d64-4aac-8fb8-405b40f5b526] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:51.521047 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7548d979-0622-4041-913b-8c356aa4fe17 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:51.521818 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7548d979-0622-4041-913b-8c356aa4fe17 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:51.522914 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7548d979-0622-4041-913b-8c356aa4fe17 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:51.524464 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7548d979-0622-4041-913b-8c356aa4fe17 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:51.525105 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7548d979-0622-4041-913b-8c356aa4fe17 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:51.525711 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7548d979-0622-4041-913b-8c356aa4fe17 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:51.647946 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-baf36413-54af-4930-8da4-6422c661c7e8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:51.656733 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-baf36413-54af-4930-8da4-6422c661c7e8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:51.658867 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-baf36413-54af-4930-8da4-6422c661c7e8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:51.660028 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-baf36413-54af-4930-8da4-6422c661c7e8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1809 microversion: 2.20 time: 0.493057 Nov 02 14:42:51.660601 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 230/480] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:42:51 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1809 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:42:51.788549 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-7548d979-0622-4041-913b-8c356aa4fe17 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa6a7aba33d4abd9389ecd2e3fa0906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e090451c7e4296a0b85c7eeb9002f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:51.796296 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-7548d979-0622-4041-913b-8c356aa4fe17 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] 10.222.0.30 "GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526" status: 200 len: 1470 microversion: 2.1 time: 0.296356 Nov 02 14:42:51.796931 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 251/481] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:51 2022] GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526 => generated 1470 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:42:51.824487 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-d354fef2-4aab-4b42-ad70-e13884782006 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-29703795"}} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:42:51.825085 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-d354fef2-4aab-4b42-ad70-e13884782006 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:51.831579 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d354fef2-4aab-4b42-ad70-e13884782006 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:51.832067 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d354fef2-4aab-4b42-ad70-e13884782006 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:51.832501 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d354fef2-4aab-4b42-ad70-e13884782006 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:51.833236 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d354fef2-4aab-4b42-ad70-e13884782006 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:51.833688 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d354fef2-4aab-4b42-ad70-e13884782006 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:51.834127 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d354fef2-4aab-4b42-ad70-e13884782006 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:52.017124 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.network.security_group_api [None req-d354fef2-4aab-4b42-ad70-e13884782006 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Adding security group fb65d1e8-d64b-4519-9c9f-59355c916132 to port 881c5e7e-3ed6-4eda-ba12-f2fc35e98f97 Nov 02 14:42:52.231484 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [req-0653a898-530e-4f29-a7fa-a6d1c5ae2789 req-b86bf6ef-0784-4494-9157-77a1c2028cbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42424cc7-8d64-4aac-8fb8-405b40f5b526", "name": "network-vif-deleted", "tag": "ef464795-086c-4a51-be10-888615a9b1d0"}]} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:42:52.247912 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-0653a898-530e-4f29-a7fa-a6d1c5ae2789 req-b86bf6ef-0784-4494-9157-77a1c2028cbc service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:52.248479 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-0653a898-530e-4f29-a7fa-a6d1c5ae2789 req-b86bf6ef-0784-4494-9157-77a1c2028cbc service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:52.248971 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-0653a898-530e-4f29-a7fa-a6d1c5ae2789 req-b86bf6ef-0784-4494-9157-77a1c2028cbc service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:52.262592 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.compute.server_external_events [req-0653a898-530e-4f29-a7fa-a6d1c5ae2789 req-b86bf6ef-0784-4494-9157-77a1c2028cbc service nova] Creating event network-vif-deleted:ef464795-086c-4a51-be10-888615a9b1d0 for instance 42424cc7-8d64-4aac-8fb8-405b40f5b526 on hv-cinder-86236 Nov 02 14:42:52.268661 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [req-0653a898-530e-4f29-a7fa-a6d1c5ae2789 req-b86bf6ef-0784-4494-9157-77a1c2028cbc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040745 Nov 02 14:42:52.269664 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 252/482] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:42:52.496779 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-b52df15a-5089-428b-9f8f-d61dc36f6d53 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:52.497507 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-b52df15a-5089-428b-9f8f-d61dc36f6d53 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] [instance: bd91069f-ef45-44b0-a9c8-022d089d2dff] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:52.504809 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b52df15a-5089-428b-9f8f-d61dc36f6d53 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:52.505899 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b52df15a-5089-428b-9f8f-d61dc36f6d53 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:52.506338 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b52df15a-5089-428b-9f8f-d61dc36f6d53 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:52.507034 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b52df15a-5089-428b-9f8f-d61dc36f6d53 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:52.507483 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b52df15a-5089-428b-9f8f-d61dc36f6d53 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:52.507933 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b52df15a-5089-428b-9f8f-d61dc36f6d53 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:52.511704 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-d354fef2-4aab-4b42-ad70-e13884782006 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "POST /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7/action" status: 202 len: 0 microversion: 2.1 time: 0.691125 Nov 02 14:42:52.512384 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 231/483] 10.222.0.30 () {60 vars in 1278 bytes} [Wed Nov 2 14:42:51 2022] POST /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7/action => generated 0 bytes in 692 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:42:52.520618 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-2c9b1df2-e60a-4708-9223-662c6012bd7d tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:52.521265 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-2c9b1df2-e60a-4708-9223-662c6012bd7d tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:52.527828 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2c9b1df2-e60a-4708-9223-662c6012bd7d tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:52.528710 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2c9b1df2-e60a-4708-9223-662c6012bd7d tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:52.529388 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2c9b1df2-e60a-4708-9223-662c6012bd7d tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:52.530235 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2c9b1df2-e60a-4708-9223-662c6012bd7d tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:52.534061 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.wsgi [None req-b52df15a-5089-428b-9f8f-d61dc36f6d53 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] HTTP exception thrown: Instance bd91069f-ef45-44b0-a9c8-022d089d2dff could not be found. Nov 02 14:42:52.536510 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-b52df15a-5089-428b-9f8f-d61dc36f6d53 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Request method failure captured: Nov 02 14:42:52.536510 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: request: GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff HTTP/1.1 Nov 02 14:42:52.536510 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Accept: application/json Nov 02 14:42:52.536510 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Accept-Encoding: identity Nov 02 14:42:52.536510 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Connection: close Nov 02 14:42:52.536510 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Content-Length: 0 Nov 02 14:42:52.536510 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Content-Type: application/json Nov 02 14:42:52.536510 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Host: 10.222.0.30 Nov 02 14:42:52.536510 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Openstack-System-Scope: None Nov 02 14:42:52.536510 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: User-Agent: python-urllib3/1.26.12 Nov 02 14:42:52.536510 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Auth-Token: gAAAAABjYoGCCxQ3uvXjuXLajn8keqq7twS2jeBUN_5-Usj9kSj2EGLAJ2D33-Z_hUOuVcJFCHVPaNR-Q5qzzAKhe4k5F-9j42teYbSMow_MoF8Q3Z-AQWkb8ZtGJ1LW3lFz9ve5wfFUuMCIqD46ekOv8mj_3aVHbAuWMzxBNy-xu5ROjfv2M4U Nov 02 14:42:52.536510 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Domain-Id: None Nov 02 14:42:52.536510 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Domain-Name: None Nov 02 14:42:52.536510 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Identity-Status: Confirmed Nov 02 14:42:52.536510 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Is-Admin-Project: True Nov 02 14:42:52.536510 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Domain-Id: default Nov 02 14:42:52.536510 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Domain-Name: Default Nov 02 14:42:52.536510 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Id: 47b8cf11e60741e29dfec5f97c462eff Nov 02 14:42:52.536510 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Name: tempest-VolumesActionsTest-428532952 Nov 02 14:42:52.536510 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Role: reader,member Nov 02 14:42:52.536510 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Roles: reader,member Nov 02 14:42:52.538466 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/47b8cf11e60741e29dfec5f97c462eff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/47b8cf11e60741e29dfec5f97c462eff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/47b8cf11e60741e29dfec5f97c462eff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_47b8cf11e60741e29dfec5f97c462eff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:42:52.538466 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant: tempest-VolumesActionsTest-428532952 Nov 02 14:42:52.538466 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant-Id: 47b8cf11e60741e29dfec5f97c462eff Nov 02 14:42:52.538466 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant-Name: tempest-VolumesActionsTest-428532952 Nov 02 14:42:52.538466 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User: tempest-VolumesActionsTest-428532952-project Nov 02 14:42:52.538466 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Domain-Id: default Nov 02 14:42:52.538466 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Domain-Name: Default Nov 02 14:42:52.538466 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Id: c51fbcb1f2714d2c825266ec673348a0 Nov 02 14:42:52.538466 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Name: tempest-VolumesActionsTest-428532952-project Nov 02 14:42:52.538466 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: method: > Nov 02 14:42:52.538466 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: exception: Instance bd91069f-ef45-44b0-a9c8-022d089d2dff could not be found. Nov 02 14:42:52.538466 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: action_args: {'id': 'bd91069f-ef45-44b0-a9c8-022d089d2dff'} Nov 02 14:42:52.539352 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:42:52.539352 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:42:52.539352 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:42:52.539352 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:42:52.539352 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:42:52.539352 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:42:52.539352 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:42:52.539352 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:42:52.539352 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:42:52.539352 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:42:52.539352 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd91069f-ef45-44b0-a9c8-022d089d2dff could not be found. Nov 02 14:42:52.539352 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:42:52.539352 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:42:52.539352 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:42:52.539352 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:42:52.539352 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:42:52.539352 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:42:52.539352 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:42:52.539352 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:42:52.539352 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:42:52.540689 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:42:52.540689 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:42:52.540689 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:42:52.540689 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:42:52.540689 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:42:52.540689 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:42:52.540689 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:42:52.540689 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd91069f-ef45-44b0-a9c8-022d089d2dff could not be found. Nov 02 14:42:52.540689 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:42:52.540689 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:42:52.540689 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:42:52.540689 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:42:52.540689 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:42:52.540689 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:42:52.540689 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:42:52.540689 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:42:52.540689 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd91069f-ef45-44b0-a9c8-022d089d2dff could not be found. Nov 02 14:42:52.540689 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:42:52.542477 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-b52df15a-5089-428b-9f8f-d61dc36f6d53 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] Returning 404 to user: Instance bd91069f-ef45-44b0-a9c8-022d089d2dff could not be found. {{(pid=119659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:42:52.543722 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-b52df15a-5089-428b-9f8f-d61dc36f6d53 tempest-VolumesActionsTest-428532952 tempest-VolumesActionsTest-428532952-project] 10.222.0.30 "GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff" status: 404 len: 111 microversion: 2.1 time: 0.051615 Nov 02 14:42:52.544762 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 253/484] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:52 2022] GET /compute/v2.1/servers/bd91069f-ef45-44b0-a9c8-022d089d2dff => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 14:42:52.556513 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2c9b1df2-e60a-4708-9223-662c6012bd7d tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:52.559907 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2c9b1df2-e60a-4708-9223-662c6012bd7d tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:52.685812 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-353689d9-0931-46a4-8edf-dacb69505c8e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:52.687049 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-353689d9-0931-46a4-8edf-dacb69505c8e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:52.697907 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-353689d9-0931-46a4-8edf-dacb69505c8e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:52.699206 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-353689d9-0931-46a4-8edf-dacb69505c8e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:52.699904 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-353689d9-0931-46a4-8edf-dacb69505c8e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:52.700855 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-353689d9-0931-46a4-8edf-dacb69505c8e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:52.701784 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-353689d9-0931-46a4-8edf-dacb69505c8e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:52.702482 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-353689d9-0931-46a4-8edf-dacb69505c8e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:52.767769 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-2c9b1df2-e60a-4708-9223-662c6012bd7d tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cc06a6df04ca4ab453de57ee84279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60a52ce75b94198ac6abb7727e7072d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:52.796880 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-2c9b1df2-e60a-4708-9223-662c6012bd7d tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7" status: 200 len: 1757 microversion: 2.1 time: 0.279778 Nov 02 14:42:52.797985 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 232/485] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:52 2022] GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7 => generated 1757 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:52.829803 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-6c8b6b5f-a977-426d-9185-a5c2ffd03642 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:52.832028 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-6c8b6b5f-a977-426d-9185-a5c2ffd03642 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] [instance: 42424cc7-8d64-4aac-8fb8-405b40f5b526] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:52.845442 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6c8b6b5f-a977-426d-9185-a5c2ffd03642 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:52.845995 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6c8b6b5f-a977-426d-9185-a5c2ffd03642 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:52.846511 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6c8b6b5f-a977-426d-9185-a5c2ffd03642 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:52.850034 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6c8b6b5f-a977-426d-9185-a5c2ffd03642 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:52.850570 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6c8b6b5f-a977-426d-9185-a5c2ffd03642 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:52.853900 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6c8b6b5f-a977-426d-9185-a5c2ffd03642 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:52.887658 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell1:SELECT=100 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:42:52.903623 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6c8b6b5f-a977-426d-9185-a5c2ffd03642 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:52.904373 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6c8b6b5f-a977-426d-9185-a5c2ffd03642 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:52.905349 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6c8b6b5f-a977-426d-9185-a5c2ffd03642 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:52.905975 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.objects.instance [None req-6c8b6b5f-a977-426d-9185-a5c2ffd03642 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lazy-loading 'fault' on Instance uuid 42424cc7-8d64-4aac-8fb8-405b40f5b526 {{(pid=119658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:42:52.921489 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-353689d9-0931-46a4-8edf-dacb69505c8e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:52.932214 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-353689d9-0931-46a4-8edf-dacb69505c8e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:52.934228 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-353689d9-0931-46a4-8edf-dacb69505c8e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:52.936245 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-353689d9-0931-46a4-8edf-dacb69505c8e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1809 microversion: 2.20 time: 0.254626 Nov 02 14:42:52.937093 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 254/486] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:42:52 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1809 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:42:52.972571 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-6c8b6b5f-a977-426d-9185-a5c2ffd03642 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa6a7aba33d4abd9389ecd2e3fa0906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e090451c7e4296a0b85c7eeb9002f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:52.982016 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-6c8b6b5f-a977-426d-9185-a5c2ffd03642 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] 10.222.0.30 "GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526" status: 200 len: 1304 microversion: 2.1 time: 0.161020 Nov 02 14:42:52.982937 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 233/487] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:52 2022] GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526 => generated 1304 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:53.963387 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-34322bbd-6139-4812-a985-8d888abc7fba tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:53.964029 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-34322bbd-6139-4812-a985-8d888abc7fba tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:53.971488 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-34322bbd-6139-4812-a985-8d888abc7fba tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:53.972001 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-34322bbd-6139-4812-a985-8d888abc7fba tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:53.972441 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-34322bbd-6139-4812-a985-8d888abc7fba tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:53.973330 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-34322bbd-6139-4812-a985-8d888abc7fba tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:53.973786 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-34322bbd-6139-4812-a985-8d888abc7fba tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:53.974217 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-34322bbd-6139-4812-a985-8d888abc7fba tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:54.008419 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-f1a4313a-e870-440a-9be7-5503bfa7ddd5 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:54.009369 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-f1a4313a-e870-440a-9be7-5503bfa7ddd5 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] [instance: 42424cc7-8d64-4aac-8fb8-405b40f5b526] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:54.017354 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f1a4313a-e870-440a-9be7-5503bfa7ddd5 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:54.017982 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f1a4313a-e870-440a-9be7-5503bfa7ddd5 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:54.018380 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f1a4313a-e870-440a-9be7-5503bfa7ddd5 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:54.019100 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f1a4313a-e870-440a-9be7-5503bfa7ddd5 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:54.019735 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f1a4313a-e870-440a-9be7-5503bfa7ddd5 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:54.020792 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f1a4313a-e870-440a-9be7-5503bfa7ddd5 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:54.036609 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.wsgi [None req-f1a4313a-e870-440a-9be7-5503bfa7ddd5 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] HTTP exception thrown: Instance 42424cc7-8d64-4aac-8fb8-405b40f5b526 could not be found. Nov 02 14:42:54.038462 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-f1a4313a-e870-440a-9be7-5503bfa7ddd5 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Request method failure captured: Nov 02 14:42:54.038462 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: request: GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526 HTTP/1.1 Nov 02 14:42:54.038462 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Accept: application/json Nov 02 14:42:54.038462 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Accept-Encoding: identity Nov 02 14:42:54.038462 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Connection: close Nov 02 14:42:54.038462 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Content-Length: 0 Nov 02 14:42:54.038462 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Content-Type: application/json Nov 02 14:42:54.038462 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Host: 10.222.0.30 Nov 02 14:42:54.038462 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Openstack-System-Scope: None Nov 02 14:42:54.038462 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: User-Agent: python-urllib3/1.26.12 Nov 02 14:42:54.038462 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Auth-Token: gAAAAABjYoHFNDZDV-9SHsZvzJd05Q8X5VKfBqemzSlatXR2KgXROMDRj9ar11zBc7BabnnmPlDJnVuc7PvNscA_j_sYYvQ-fX_i_gOqXYkokz0aRooPT7x9S6FQZHeE9l05U7BM1DcEnI7ZsYt59czuJFe3mRDPNw2RSpysxX5Mzk8Sb3YBxUw Nov 02 14:42:54.038462 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Domain-Id: None Nov 02 14:42:54.038462 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Domain-Name: None Nov 02 14:42:54.038462 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Identity-Status: Confirmed Nov 02 14:42:54.038462 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Is-Admin-Project: True Nov 02 14:42:54.038462 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Domain-Id: default Nov 02 14:42:54.038462 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Domain-Name: Default Nov 02 14:42:54.038462 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Id: f8e090451c7e4296a0b85c7eeb9002f7 Nov 02 14:42:54.038462 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Name: tempest-VolumesNegativeTest-1892688683 Nov 02 14:42:54.038462 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Role: reader,member Nov 02 14:42:54.038462 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Roles: reader,member Nov 02 14:42:54.040057 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f8e090451c7e4296a0b85c7eeb9002f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f8e090451c7e4296a0b85c7eeb9002f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f8e090451c7e4296a0b85c7eeb9002f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f8e090451c7e4296a0b85c7eeb9002f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:42:54.040057 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant: tempest-VolumesNegativeTest-1892688683 Nov 02 14:42:54.040057 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant-Id: f8e090451c7e4296a0b85c7eeb9002f7 Nov 02 14:42:54.040057 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant-Name: tempest-VolumesNegativeTest-1892688683 Nov 02 14:42:54.040057 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User: tempest-VolumesNegativeTest-1892688683-project Nov 02 14:42:54.040057 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Domain-Id: default Nov 02 14:42:54.040057 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Domain-Name: Default Nov 02 14:42:54.040057 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Id: 2fa6a7aba33d4abd9389ecd2e3fa0906 Nov 02 14:42:54.040057 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Name: tempest-VolumesNegativeTest-1892688683-project Nov 02 14:42:54.040057 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: method: > Nov 02 14:42:54.040057 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: exception: Instance 42424cc7-8d64-4aac-8fb8-405b40f5b526 could not be found. Nov 02 14:42:54.040057 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: action_args: {'id': '42424cc7-8d64-4aac-8fb8-405b40f5b526'} Nov 02 14:42:54.041272 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:42:54.041272 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:42:54.041272 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:42:54.041272 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:42:54.041272 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:42:54.041272 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:42:54.041272 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:42:54.041272 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:42:54.041272 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:42:54.041272 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:42:54.041272 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42424cc7-8d64-4aac-8fb8-405b40f5b526 could not be found. Nov 02 14:42:54.041272 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:42:54.041272 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:42:54.041272 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:42:54.041272 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:42:54.041272 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:42:54.041272 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:42:54.041272 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:42:54.041272 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:42:54.041272 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:42:54.042519 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:42:54.042519 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:42:54.042519 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:42:54.042519 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:42:54.042519 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:42:54.042519 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:42:54.042519 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:42:54.042519 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42424cc7-8d64-4aac-8fb8-405b40f5b526 could not be found. Nov 02 14:42:54.042519 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:42:54.042519 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:42:54.042519 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:42:54.042519 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:42:54.042519 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:42:54.042519 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:42:54.042519 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:42:54.042519 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:42:54.042519 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42424cc7-8d64-4aac-8fb8-405b40f5b526 could not be found. Nov 02 14:42:54.042519 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:42:54.043788 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-f1a4313a-e870-440a-9be7-5503bfa7ddd5 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] Returning 404 to user: Instance 42424cc7-8d64-4aac-8fb8-405b40f5b526 could not be found. {{(pid=119658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:42:54.043788 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-f1a4313a-e870-440a-9be7-5503bfa7ddd5 tempest-VolumesNegativeTest-1892688683 tempest-VolumesNegativeTest-1892688683-project] 10.222.0.30 "GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526" status: 404 len: 111 microversion: 2.1 time: 0.036877 Nov 02 14:42:54.047944 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 234/488] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:54 2022] GET /compute/v2.1/servers/42424cc7-8d64-4aac-8fb8-405b40f5b526 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:42:54.128959 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-34322bbd-6139-4812-a985-8d888abc7fba tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:54.144308 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-34322bbd-6139-4812-a985-8d888abc7fba tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:54.144308 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-34322bbd-6139-4812-a985-8d888abc7fba tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:54.144308 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-34322bbd-6139-4812-a985-8d888abc7fba tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1809 microversion: 2.20 time: 0.183708 Nov 02 14:42:54.144894 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 255/489] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:42:53 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1809 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:42:54.284670 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [req-d96f4eef-352d-45d6-8010-b306d02156f8 req-e6b68157-1897-499c-a883-5e2ea5897eae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24d10c5a-012e-4d8a-8188-c2289e1605b7", "tag": "881c5e7e-3ed6-4eda-ba12-f2fc35e98f97"}]} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:42:54.294176 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-d96f4eef-352d-45d6-8010-b306d02156f8 req-e6b68157-1897-499c-a883-5e2ea5897eae service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:54.294640 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-d96f4eef-352d-45d6-8010-b306d02156f8 req-e6b68157-1897-499c-a883-5e2ea5897eae service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:54.295068 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-d96f4eef-352d-45d6-8010-b306d02156f8 req-e6b68157-1897-499c-a883-5e2ea5897eae service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:54.306796 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.compute.server_external_events [req-d96f4eef-352d-45d6-8010-b306d02156f8 req-e6b68157-1897-499c-a883-5e2ea5897eae service nova] Creating event network-changed:881c5e7e-3ed6-4eda-ba12-f2fc35e98f97 for instance 24d10c5a-012e-4d8a-8188-c2289e1605b7 on hv-cinder-86236 Nov 02 14:42:54.311791 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [req-d96f4eef-352d-45d6-8010-b306d02156f8 req-e6b68157-1897-499c-a883-5e2ea5897eae service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031604 Nov 02 14:42:54.312367 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 235/490] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:42:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:42:55.172233 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-ee401277-1300-4633-9c4c-4173d446d7f8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:55.173239 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-ee401277-1300-4633-9c4c-4173d446d7f8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:55.176154 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 14:42:55.176355 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Wed Nov 2 14:42:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca (ip 10.222.0.30) !!! Nov 02 14:42:55.182968 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ee401277-1300-4633-9c4c-4173d446d7f8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:55.183453 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ee401277-1300-4633-9c4c-4173d446d7f8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:55.183889 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ee401277-1300-4633-9c4c-4173d446d7f8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:55.184583 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ee401277-1300-4633-9c4c-4173d446d7f8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:55.186482 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ee401277-1300-4633-9c4c-4173d446d7f8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:55.186482 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ee401277-1300-4633-9c4c-4173d446d7f8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:55.347266 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-ee401277-1300-4633-9c4c-4173d446d7f8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:55.362647 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-ee401277-1300-4633-9c4c-4173d446d7f8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:55.364132 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-ee401277-1300-4633-9c4c-4173d446d7f8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:55.365317 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-ee401277-1300-4633-9c4c-4173d446d7f8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1809 microversion: 2.20 time: 0.196916 Nov 02 14:42:55.365874 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 256/491] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:42:55 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1809 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:42:56.391707 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-d9aa22bc-2487-4fa0-8500-76b4eec4a84e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:56.392514 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-d9aa22bc-2487-4fa0-8500-76b4eec4a84e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:56.394661 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_api:SELECT=89 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:42:56.399551 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d9aa22bc-2487-4fa0-8500-76b4eec4a84e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:56.400030 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d9aa22bc-2487-4fa0-8500-76b4eec4a84e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:56.400465 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d9aa22bc-2487-4fa0-8500-76b4eec4a84e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:56.401203 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d9aa22bc-2487-4fa0-8500-76b4eec4a84e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:56.401655 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d9aa22bc-2487-4fa0-8500-76b4eec4a84e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:56.402079 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d9aa22bc-2487-4fa0-8500-76b4eec4a84e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:56.541029 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-d9aa22bc-2487-4fa0-8500-76b4eec4a84e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:56.549717 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-d9aa22bc-2487-4fa0-8500-76b4eec4a84e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:56.551244 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-d9aa22bc-2487-4fa0-8500-76b4eec4a84e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:56.553550 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-d9aa22bc-2487-4fa0-8500-76b4eec4a84e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1809 microversion: 2.20 time: 0.165822 Nov 02 14:42:56.554122 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 236/492] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:42:56 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:42:57.579772 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-8174fd1d-790b-4d7e-9a11-f7816399884d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:57.580471 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-8174fd1d-790b-4d7e-9a11-f7816399884d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:57.582871 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:42:57.587497 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8174fd1d-790b-4d7e-9a11-f7816399884d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:57.587975 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8174fd1d-790b-4d7e-9a11-f7816399884d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:57.588408 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8174fd1d-790b-4d7e-9a11-f7816399884d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:57.589127 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8174fd1d-790b-4d7e-9a11-f7816399884d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:57.589575 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8174fd1d-790b-4d7e-9a11-f7816399884d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:57.589997 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8174fd1d-790b-4d7e-9a11-f7816399884d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:57.610326 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:42:57.740319 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-8174fd1d-790b-4d7e-9a11-f7816399884d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:57.751347 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-8174fd1d-790b-4d7e-9a11-f7816399884d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:57.752810 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-8174fd1d-790b-4d7e-9a11-f7816399884d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:57.754033 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-8174fd1d-790b-4d7e-9a11-f7816399884d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1809 microversion: 2.20 time: 0.178645 Nov 02 14:42:57.754598 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 257/493] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:42:57 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:42:57.815262 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [req-38d9b744-b2fb-4abe-9675-fafe7c8e0ac6 req-0a37885a-f27e-43a0-9adf-4546b6c67c1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d0f8129-8155-4b7c-a462-f9c067ecfbca", "name": "network-vif-plugged", "status": "completed", "tag": "af3cc54b-a081-4f0c-aad1-a5c16e7530c7"}]} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:42:57.825423 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-38d9b744-b2fb-4abe-9675-fafe7c8e0ac6 req-0a37885a-f27e-43a0-9adf-4546b6c67c1b service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:57.825905 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-38d9b744-b2fb-4abe-9675-fafe7c8e0ac6 req-0a37885a-f27e-43a0-9adf-4546b6c67c1b service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:57.826338 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-38d9b744-b2fb-4abe-9675-fafe7c8e0ac6 req-0a37885a-f27e-43a0-9adf-4546b6c67c1b service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:57.839019 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.compute.server_external_events [req-38d9b744-b2fb-4abe-9675-fafe7c8e0ac6 req-0a37885a-f27e-43a0-9adf-4546b6c67c1b service nova] Creating event network-vif-plugged:af3cc54b-a081-4f0c-aad1-a5c16e7530c7 for instance 5d0f8129-8155-4b7c-a462-f9c067ecfbca on hv-cinder-86236 Nov 02 14:42:57.844086 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [req-38d9b744-b2fb-4abe-9675-fafe7c8e0ac6 req-0a37885a-f27e-43a0-9adf-4546b6c67c1b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034130 Nov 02 14:42:57.844962 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 237/494] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:42:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:42:58.783270 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-83472f7b-c9e9-4c6d-b167-bd260874ef5b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:58.784795 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-83472f7b-c9e9-4c6d-b167-bd260874ef5b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:58.795530 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-83472f7b-c9e9-4c6d-b167-bd260874ef5b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:58.796476 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-83472f7b-c9e9-4c6d-b167-bd260874ef5b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:58.797183 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-83472f7b-c9e9-4c6d-b167-bd260874ef5b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:58.814776 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-83472f7b-c9e9-4c6d-b167-bd260874ef5b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:58.815769 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-83472f7b-c9e9-4c6d-b167-bd260874ef5b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:58.816586 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-83472f7b-c9e9-4c6d-b167-bd260874ef5b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:58.861735 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-132c3fcb-23df-4fcf-a6eb-94f30d580032 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e390f0c9-4a9d-4e80-b566-bcf86fcd75fa"}} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:42:58.864559 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-132c3fcb-23df-4fcf-a6eb-94f30d580032 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:58.874582 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-132c3fcb-23df-4fcf-a6eb-94f30d580032 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:58.877736 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-132c3fcb-23df-4fcf-a6eb-94f30d580032 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:58.878628 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-132c3fcb-23df-4fcf-a6eb-94f30d580032 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:58.879543 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-132c3fcb-23df-4fcf-a6eb-94f30d580032 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:58.880291 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-132c3fcb-23df-4fcf-a6eb-94f30d580032 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:58.881064 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-132c3fcb-23df-4fcf-a6eb-94f30d580032 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:59.124162 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-83472f7b-c9e9-4c6d-b167-bd260874ef5b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:59.134521 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-83472f7b-c9e9-4c6d-b167-bd260874ef5b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:59.136728 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-83472f7b-c9e9-4c6d-b167-bd260874ef5b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:59.138121 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-83472f7b-c9e9-4c6d-b167-bd260874ef5b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1809 microversion: 2.20 time: 0.362317 Nov 02 14:42:59.138889 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 258/495] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:42:58 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1809 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:43:00.190130 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-f71aecb9-5129-4701-9589-d5c310a99c2d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:00.190130 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-f71aecb9-5129-4701-9589-d5c310a99c2d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:00.190130 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f71aecb9-5129-4701-9589-d5c310a99c2d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:00.190130 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f71aecb9-5129-4701-9589-d5c310a99c2d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:00.191068 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f71aecb9-5129-4701-9589-d5c310a99c2d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:00.191068 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f71aecb9-5129-4701-9589-d5c310a99c2d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:00.191068 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f71aecb9-5129-4701-9589-d5c310a99c2d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:00.191068 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f71aecb9-5129-4701-9589-d5c310a99c2d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:00.518293 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-f71aecb9-5129-4701-9589-d5c310a99c2d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:00.518293 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-f71aecb9-5129-4701-9589-d5c310a99c2d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:00.518767 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-f71aecb9-5129-4701-9589-d5c310a99c2d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:00.518767 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-f71aecb9-5129-4701-9589-d5c310a99c2d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1809 microversion: 2.20 time: 0.343374 Nov 02 14:43:00.518767 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 259/496] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:43:00 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1809 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:43:00.544979 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-35a6d7d9-cc56-482a-b509-cd9fac17079e tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:43:00.547245 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-35a6d7d9-cc56-482a-b509-cd9fac17079e tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:00.553841 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-35a6d7d9-cc56-482a-b509-cd9fac17079e tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:00.554463 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-35a6d7d9-cc56-482a-b509-cd9fac17079e tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:00.554743 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-35a6d7d9-cc56-482a-b509-cd9fac17079e tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:00.555446 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-35a6d7d9-cc56-482a-b509-cd9fac17079e tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:00.555898 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-35a6d7d9-cc56-482a-b509-cd9fac17079e tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:00.556318 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-35a6d7d9-cc56-482a-b509-cd9fac17079e tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:01.150752 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-35a6d7d9-cc56-482a-b509-cd9fac17079e tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "POST /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7/action" status: 202 len: 0 microversion: 2.1 time: 0.620057 Nov 02 14:43:01.156583 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 260/497] 10.222.0.30 () {60 vars in 1278 bytes} [Wed Nov 2 14:43:00 2022] POST /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7/action => generated 0 bytes in 627 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:43:01.193906 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-46ea584e-0c71-42f0-9f17-b6a917dfb267 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:01.194658 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-46ea584e-0c71-42f0-9f17-b6a917dfb267 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:01.226008 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-46ea584e-0c71-42f0-9f17-b6a917dfb267 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:01.226834 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-46ea584e-0c71-42f0-9f17-b6a917dfb267 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:01.228693 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-46ea584e-0c71-42f0-9f17-b6a917dfb267 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:01.229680 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-46ea584e-0c71-42f0-9f17-b6a917dfb267 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:01.230190 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-46ea584e-0c71-42f0-9f17-b6a917dfb267 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:01.240016 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-46ea584e-0c71-42f0-9f17-b6a917dfb267 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:01.296282 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-132c3fcb-23df-4fcf-a6eb-94f30d580032 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "POST /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.439641 Nov 02 14:43:01.298707 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 238/498] 10.222.0.30 () {60 vars in 1323 bytes} [Wed Nov 2 14:42:58 2022] POST /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91/os-volume_attachments => generated 194 bytes in 2442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:43:01.553673 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-d4816e1f-34a3-41af-9d46-b476168ba0f5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:01.554368 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-d4816e1f-34a3-41af-9d46-b476168ba0f5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:01.567123 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d4816e1f-34a3-41af-9d46-b476168ba0f5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:01.569578 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d4816e1f-34a3-41af-9d46-b476168ba0f5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:01.576817 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d4816e1f-34a3-41af-9d46-b476168ba0f5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:01.576817 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d4816e1f-34a3-41af-9d46-b476168ba0f5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:01.576817 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d4816e1f-34a3-41af-9d46-b476168ba0f5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:01.576817 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d4816e1f-34a3-41af-9d46-b476168ba0f5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:01.691183 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-46ea584e-0c71-42f0-9f17-b6a917dfb267 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cc06a6df04ca4ab453de57ee84279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60a52ce75b94198ac6abb7727e7072d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:01.700379 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-46ea584e-0c71-42f0-9f17-b6a917dfb267 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7" status: 200 len: 1749 microversion: 2.1 time: 0.540230 Nov 02 14:43:01.718719 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 261/499] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:01 2022] GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7 => generated 1749 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:02.040602 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-d4816e1f-34a3-41af-9d46-b476168ba0f5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:02.061840 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-d4816e1f-34a3-41af-9d46-b476168ba0f5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:02.063952 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-d4816e1f-34a3-41af-9d46-b476168ba0f5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:02.065168 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-d4816e1f-34a3-41af-9d46-b476168ba0f5 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1809 microversion: 2.20 time: 0.518771 Nov 02 14:43:02.065726 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 239/500] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:43:01 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1809 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:43:02.747953 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-0d268538-6826-4d5b-b54f-761cd5dfae56 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:02.749319 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-0d268538-6826-4d5b-b54f-761cd5dfae56 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:02.758217 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0d268538-6826-4d5b-b54f-761cd5dfae56 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:02.758992 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0d268538-6826-4d5b-b54f-761cd5dfae56 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:02.759622 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0d268538-6826-4d5b-b54f-761cd5dfae56 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:02.760906 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0d268538-6826-4d5b-b54f-761cd5dfae56 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:02.762194 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0d268538-6826-4d5b-b54f-761cd5dfae56 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:02.762898 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0d268538-6826-4d5b-b54f-761cd5dfae56 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:03.014061 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-0d268538-6826-4d5b-b54f-761cd5dfae56 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cc06a6df04ca4ab453de57ee84279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60a52ce75b94198ac6abb7727e7072d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:03.023869 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-0d268538-6826-4d5b-b54f-761cd5dfae56 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7" status: 200 len: 1754 microversion: 2.1 time: 0.280725 Nov 02 14:43:03.024454 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 262/501] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:02 2022] GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7 => generated 1754 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:03.092559 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-4f5dd27c-a95f-4158-9a85-3d19f6bed441 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:03.093351 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-4f5dd27c-a95f-4158-9a85-3d19f6bed441 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:03.102412 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4f5dd27c-a95f-4158-9a85-3d19f6bed441 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:03.103515 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4f5dd27c-a95f-4158-9a85-3d19f6bed441 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:03.104200 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4f5dd27c-a95f-4158-9a85-3d19f6bed441 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:03.105406 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4f5dd27c-a95f-4158-9a85-3d19f6bed441 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:03.106071 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4f5dd27c-a95f-4158-9a85-3d19f6bed441 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:03.106876 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4f5dd27c-a95f-4158-9a85-3d19f6bed441 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:03.281581 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-4f5dd27c-a95f-4158-9a85-3d19f6bed441 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:03.296359 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-4f5dd27c-a95f-4158-9a85-3d19f6bed441 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:03.299286 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-4f5dd27c-a95f-4158-9a85-3d19f6bed441 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:03.301098 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-4f5dd27c-a95f-4158-9a85-3d19f6bed441 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1796 microversion: 2.20 time: 0.212726 Nov 02 14:43:03.314368 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 240/502] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:43:03 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1796 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:43:04.051481 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-d1251e7e-fda3-48d8-9320-af767fa59cfb tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:04.053651 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-d1251e7e-fda3-48d8-9320-af767fa59cfb tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:04.068607 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d1251e7e-fda3-48d8-9320-af767fa59cfb tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:04.074742 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d1251e7e-fda3-48d8-9320-af767fa59cfb tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:04.075553 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d1251e7e-fda3-48d8-9320-af767fa59cfb tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:04.089252 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d1251e7e-fda3-48d8-9320-af767fa59cfb tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:04.089252 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d1251e7e-fda3-48d8-9320-af767fa59cfb tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:04.089252 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d1251e7e-fda3-48d8-9320-af767fa59cfb tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:04.276978 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-d1251e7e-fda3-48d8-9320-af767fa59cfb tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cc06a6df04ca4ab453de57ee84279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60a52ce75b94198ac6abb7727e7072d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:04.289703 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-d1251e7e-fda3-48d8-9320-af767fa59cfb tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7" status: 200 len: 1754 microversion: 2.1 time: 0.242332 Nov 02 14:43:04.292415 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 263/503] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:04 2022] GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7 => generated 1754 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:05.317488 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-9a5e883a-487f-45f1-9348-8f90077b1a11 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:05.318113 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-9a5e883a-487f-45f1-9348-8f90077b1a11 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:05.325383 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9a5e883a-487f-45f1-9348-8f90077b1a11 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:05.325874 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9a5e883a-487f-45f1-9348-8f90077b1a11 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:05.326324 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9a5e883a-487f-45f1-9348-8f90077b1a11 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:05.327055 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9a5e883a-487f-45f1-9348-8f90077b1a11 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:05.327610 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9a5e883a-487f-45f1-9348-8f90077b1a11 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:05.328051 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9a5e883a-487f-45f1-9348-8f90077b1a11 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:05.520369 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-9a5e883a-487f-45f1-9348-8f90077b1a11 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cc06a6df04ca4ab453de57ee84279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60a52ce75b94198ac6abb7727e7072d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:05.530332 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-9a5e883a-487f-45f1-9348-8f90077b1a11 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7" status: 200 len: 1754 microversion: 2.1 time: 0.217801 Nov 02 14:43:05.531380 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 241/504] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:05 2022] GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7 => generated 1754 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:06.555934 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-3aa73419-e6c3-4dad-be93-124ca966d1e5 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:06.556538 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-3aa73419-e6c3-4dad-be93-124ca966d1e5 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:06.564184 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3aa73419-e6c3-4dad-be93-124ca966d1e5 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:06.568053 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3aa73419-e6c3-4dad-be93-124ca966d1e5 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:06.568053 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3aa73419-e6c3-4dad-be93-124ca966d1e5 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:06.568053 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3aa73419-e6c3-4dad-be93-124ca966d1e5 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:06.568053 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3aa73419-e6c3-4dad-be93-124ca966d1e5 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:06.568404 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3aa73419-e6c3-4dad-be93-124ca966d1e5 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:06.728156 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-3aa73419-e6c3-4dad-be93-124ca966d1e5 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cc06a6df04ca4ab453de57ee84279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60a52ce75b94198ac6abb7727e7072d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:06.739708 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-3aa73419-e6c3-4dad-be93-124ca966d1e5 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7" status: 200 len: 1754 microversion: 2.1 time: 0.187565 Nov 02 14:43:06.740844 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 264/505] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:06 2022] GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7 => generated 1754 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:07.763882 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-a4d8bcc0-a22c-456d-9f2f-a797dea388df tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:07.764630 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-a4d8bcc0-a22c-456d-9f2f-a797dea388df tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:07.771912 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a4d8bcc0-a22c-456d-9f2f-a797dea388df tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:07.772657 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a4d8bcc0-a22c-456d-9f2f-a797dea388df tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:07.773388 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a4d8bcc0-a22c-456d-9f2f-a797dea388df tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:07.774373 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a4d8bcc0-a22c-456d-9f2f-a797dea388df tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:07.774986 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a4d8bcc0-a22c-456d-9f2f-a797dea388df tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:07.775606 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a4d8bcc0-a22c-456d-9f2f-a797dea388df tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:08.024397 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-a4d8bcc0-a22c-456d-9f2f-a797dea388df tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cc06a6df04ca4ab453de57ee84279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60a52ce75b94198ac6abb7727e7072d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:08.036316 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-a4d8bcc0-a22c-456d-9f2f-a797dea388df tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7" status: 200 len: 1754 microversion: 2.1 time: 0.275910 Nov 02 14:43:08.041047 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 242/506] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:07 2022] GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7 => generated 1754 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:09.075219 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-eb5d7953-1e8b-4d0e-8958-7d297a59b1d7 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:09.075851 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-eb5d7953-1e8b-4d0e-8958-7d297a59b1d7 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:09.083212 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-eb5d7953-1e8b-4d0e-8958-7d297a59b1d7 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:09.083694 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-eb5d7953-1e8b-4d0e-8958-7d297a59b1d7 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:09.084128 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-eb5d7953-1e8b-4d0e-8958-7d297a59b1d7 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:09.084828 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-eb5d7953-1e8b-4d0e-8958-7d297a59b1d7 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:09.085308 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-eb5d7953-1e8b-4d0e-8958-7d297a59b1d7 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:09.085729 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-eb5d7953-1e8b-4d0e-8958-7d297a59b1d7 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:09.264231 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-eb5d7953-1e8b-4d0e-8958-7d297a59b1d7 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cc06a6df04ca4ab453de57ee84279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60a52ce75b94198ac6abb7727e7072d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:09.274537 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-eb5d7953-1e8b-4d0e-8958-7d297a59b1d7 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7" status: 200 len: 1754 microversion: 2.1 time: 0.203322 Nov 02 14:43:09.275503 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 265/507] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:09 2022] GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7 => generated 1754 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:10.315884 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-12c42e3f-da24-48d0-9e11-31c1bbfb2272 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:10.316833 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-12c42e3f-da24-48d0-9e11-31c1bbfb2272 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:10.362698 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-12c42e3f-da24-48d0-9e11-31c1bbfb2272 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:10.363493 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-12c42e3f-da24-48d0-9e11-31c1bbfb2272 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:10.364098 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-12c42e3f-da24-48d0-9e11-31c1bbfb2272 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:10.365055 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-12c42e3f-da24-48d0-9e11-31c1bbfb2272 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:10.366859 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-12c42e3f-da24-48d0-9e11-31c1bbfb2272 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:10.368170 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-12c42e3f-da24-48d0-9e11-31c1bbfb2272 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:10.543810 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-12c42e3f-da24-48d0-9e11-31c1bbfb2272 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cc06a6df04ca4ab453de57ee84279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60a52ce75b94198ac6abb7727e7072d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:10.557153 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-12c42e3f-da24-48d0-9e11-31c1bbfb2272 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7" status: 200 len: 1754 microversion: 2.1 time: 0.252394 Nov 02 14:43:10.558342 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 243/508] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:10 2022] GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7 => generated 1754 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:11.570642 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-b0bf2df3-2420-414b-aeef-f6254261b3ad tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:43:11.572959 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-b0bf2df3-2420-414b-aeef-f6254261b3ad tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:11.581549 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-8fe97189-0802-454c-b681-9825db4771a8 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:11.582801 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-8fe97189-0802-454c-b681-9825db4771a8 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:11.590352 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b0bf2df3-2420-414b-aeef-f6254261b3ad tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:11.593022 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b0bf2df3-2420-414b-aeef-f6254261b3ad tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:11.593483 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b0bf2df3-2420-414b-aeef-f6254261b3ad tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:11.594775 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b0bf2df3-2420-414b-aeef-f6254261b3ad tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:11.595253 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b0bf2df3-2420-414b-aeef-f6254261b3ad tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:11.595682 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b0bf2df3-2420-414b-aeef-f6254261b3ad tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:11.601116 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8fe97189-0802-454c-b681-9825db4771a8 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:11.601613 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8fe97189-0802-454c-b681-9825db4771a8 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:11.602224 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8fe97189-0802-454c-b681-9825db4771a8 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:11.603092 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8fe97189-0802-454c-b681-9825db4771a8 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:11.603708 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8fe97189-0802-454c-b681-9825db4771a8 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:11.604950 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8fe97189-0802-454c-b681-9825db4771a8 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:11.638403 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.objects.instance [None req-b0bf2df3-2420-414b-aeef-f6254261b3ad tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lazy-loading 'flavor' on Instance uuid 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 {{(pid=119659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:43:11.793205 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-8fe97189-0802-454c-b681-9825db4771a8 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cc06a6df04ca4ab453de57ee84279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60a52ce75b94198ac6abb7727e7072d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:11.803265 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-8fe97189-0802-454c-b681-9825db4771a8 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7" status: 200 len: 1754 microversion: 2.1 time: 0.225624 Nov 02 14:43:11.803841 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 244/509] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:11 2022] GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7 => generated 1754 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:12.053071 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-b0bf2df3-2420-414b-aeef-f6254261b3ad tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "POST /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91/action" status: 200 len: 32 microversion: 2.1 time: 0.486061 Nov 02 14:43:12.054468 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 266/510] 10.222.0.30 () {60 vars in 1278 bytes} [Wed Nov 2 14:43:11 2022] POST /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91/action => generated 32 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 14:43:12.064697 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-299a2370-2b9c-4a5c-b0af-c5e83bbecfc3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:12.065662 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-299a2370-2b9c-4a5c-b0af-c5e83bbecfc3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:12.072024 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-299a2370-2b9c-4a5c-b0af-c5e83bbecfc3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:12.072599 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-299a2370-2b9c-4a5c-b0af-c5e83bbecfc3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:12.073338 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-299a2370-2b9c-4a5c-b0af-c5e83bbecfc3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:12.074242 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-299a2370-2b9c-4a5c-b0af-c5e83bbecfc3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:12.074974 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-299a2370-2b9c-4a5c-b0af-c5e83bbecfc3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:12.075622 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-299a2370-2b9c-4a5c-b0af-c5e83bbecfc3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:12.237792 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-299a2370-2b9c-4a5c-b0af-c5e83bbecfc3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:12.247557 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-299a2370-2b9c-4a5c-b0af-c5e83bbecfc3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91" status: 200 len: 1736 microversion: 2.1 time: 0.187269 Nov 02 14:43:12.248247 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 245/511] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:12 2022] GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 => generated 1736 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:12.828495 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-5779a446-0ddf-4b5c-9d5a-7d1d60d3fd91 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:12.829274 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-5779a446-0ddf-4b5c-9d5a-7d1d60d3fd91 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:12.836685 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5779a446-0ddf-4b5c-9d5a-7d1d60d3fd91 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:12.837272 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5779a446-0ddf-4b5c-9d5a-7d1d60d3fd91 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:12.837712 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5779a446-0ddf-4b5c-9d5a-7d1d60d3fd91 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:12.838407 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5779a446-0ddf-4b5c-9d5a-7d1d60d3fd91 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:12.838860 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5779a446-0ddf-4b5c-9d5a-7d1d60d3fd91 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:12.839288 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5779a446-0ddf-4b5c-9d5a-7d1d60d3fd91 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:13.000968 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-5779a446-0ddf-4b5c-9d5a-7d1d60d3fd91 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cc06a6df04ca4ab453de57ee84279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60a52ce75b94198ac6abb7727e7072d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:13.009991 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-5779a446-0ddf-4b5c-9d5a-7d1d60d3fd91 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7" status: 200 len: 1754 microversion: 2.1 time: 0.185827 Nov 02 14:43:13.010931 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 267/512] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:12 2022] GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7 => generated 1754 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:13.271985 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-26e56fb0-868d-410b-95f0-307aec4a2737 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:13.272667 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-26e56fb0-868d-410b-95f0-307aec4a2737 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:13.279320 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-26e56fb0-868d-410b-95f0-307aec4a2737 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:13.279960 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-26e56fb0-868d-410b-95f0-307aec4a2737 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:13.280483 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-26e56fb0-868d-410b-95f0-307aec4a2737 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:13.281338 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-26e56fb0-868d-410b-95f0-307aec4a2737 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:13.281883 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-26e56fb0-868d-410b-95f0-307aec4a2737 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:13.282774 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-26e56fb0-868d-410b-95f0-307aec4a2737 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:13.448871 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-26e56fb0-868d-410b-95f0-307aec4a2737 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:13.458810 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-26e56fb0-868d-410b-95f0-307aec4a2737 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91" status: 200 len: 1736 microversion: 2.1 time: 0.190550 Nov 02 14:43:13.463419 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 246/513] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:13 2022] GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 => generated 1736 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:14.035503 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-a7e5258f-6800-42ba-b902-12b5969b667e tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:14.036496 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-a7e5258f-6800-42ba-b902-12b5969b667e tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:14.043790 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a7e5258f-6800-42ba-b902-12b5969b667e tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:14.044568 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a7e5258f-6800-42ba-b902-12b5969b667e tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:14.045111 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a7e5258f-6800-42ba-b902-12b5969b667e tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:14.046099 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a7e5258f-6800-42ba-b902-12b5969b667e tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:14.046912 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a7e5258f-6800-42ba-b902-12b5969b667e tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:14.048149 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a7e5258f-6800-42ba-b902-12b5969b667e tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:14.386026 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-a7e5258f-6800-42ba-b902-12b5969b667e tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cc06a6df04ca4ab453de57ee84279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60a52ce75b94198ac6abb7727e7072d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:14.403569 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-a7e5258f-6800-42ba-b902-12b5969b667e tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7" status: 200 len: 1754 microversion: 2.1 time: 0.371206 Nov 02 14:43:14.404409 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 268/514] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:14 2022] GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7 => generated 1754 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:14.485814 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-3260f9ee-ef3c-42a5-b7a8-1891acbcc163 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:14.486346 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-3260f9ee-ef3c-42a5-b7a8-1891acbcc163 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:14.496977 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3260f9ee-ef3c-42a5-b7a8-1891acbcc163 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:14.497804 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3260f9ee-ef3c-42a5-b7a8-1891acbcc163 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:14.498336 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3260f9ee-ef3c-42a5-b7a8-1891acbcc163 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:14.499261 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3260f9ee-ef3c-42a5-b7a8-1891acbcc163 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:14.499790 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3260f9ee-ef3c-42a5-b7a8-1891acbcc163 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:14.501141 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3260f9ee-ef3c-42a5-b7a8-1891acbcc163 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:14.657631 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-3260f9ee-ef3c-42a5-b7a8-1891acbcc163 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:14.668100 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-3260f9ee-ef3c-42a5-b7a8-1891acbcc163 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91" status: 200 len: 1736 microversion: 2.1 time: 0.186779 Nov 02 14:43:14.669355 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 247/515] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:14 2022] GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 => generated 1736 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:15.430158 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-f4b13a94-e80a-4a95-ba2c-da0ce21e58f1 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:15.432025 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-f4b13a94-e80a-4a95-ba2c-da0ce21e58f1 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:15.441585 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f4b13a94-e80a-4a95-ba2c-da0ce21e58f1 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:15.442999 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f4b13a94-e80a-4a95-ba2c-da0ce21e58f1 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:15.443700 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f4b13a94-e80a-4a95-ba2c-da0ce21e58f1 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:15.444935 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f4b13a94-e80a-4a95-ba2c-da0ce21e58f1 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:15.446486 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f4b13a94-e80a-4a95-ba2c-da0ce21e58f1 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:15.447160 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f4b13a94-e80a-4a95-ba2c-da0ce21e58f1 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:15.698438 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-f4b13a94-e80a-4a95-ba2c-da0ce21e58f1 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cc06a6df04ca4ab453de57ee84279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60a52ce75b94198ac6abb7727e7072d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:15.700045 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-045bf294-b2be-4eb9-9dc1-dbe033572219 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:15.700663 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-045bf294-b2be-4eb9-9dc1-dbe033572219 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:15.720272 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-045bf294-b2be-4eb9-9dc1-dbe033572219 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:15.720767 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-045bf294-b2be-4eb9-9dc1-dbe033572219 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:15.721252 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-045bf294-b2be-4eb9-9dc1-dbe033572219 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:15.721975 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-045bf294-b2be-4eb9-9dc1-dbe033572219 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:15.722431 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-045bf294-b2be-4eb9-9dc1-dbe033572219 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:15.722867 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-045bf294-b2be-4eb9-9dc1-dbe033572219 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:15.728405 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-f4b13a94-e80a-4a95-ba2c-da0ce21e58f1 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7" status: 200 len: 1754 microversion: 2.1 time: 0.303634 Nov 02 14:43:15.741063 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 269/516] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:15 2022] GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7 => generated 1754 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:15.927698 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-045bf294-b2be-4eb9-9dc1-dbe033572219 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:15.952367 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-045bf294-b2be-4eb9-9dc1-dbe033572219 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91" status: 200 len: 1736 microversion: 2.1 time: 0.261223 Nov 02 14:43:15.954696 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 248/517] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:15 2022] GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 => generated 1736 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:16.757458 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-38f85ebe-3894-4774-aebe-54773b69415d tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:16.758244 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-38f85ebe-3894-4774-aebe-54773b69415d tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:16.765054 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-38f85ebe-3894-4774-aebe-54773b69415d tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:16.765543 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-38f85ebe-3894-4774-aebe-54773b69415d tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:16.766080 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-38f85ebe-3894-4774-aebe-54773b69415d tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:16.766780 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-38f85ebe-3894-4774-aebe-54773b69415d tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:16.767222 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-38f85ebe-3894-4774-aebe-54773b69415d tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:16.767644 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-38f85ebe-3894-4774-aebe-54773b69415d tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:16.931350 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-38f85ebe-3894-4774-aebe-54773b69415d tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cc06a6df04ca4ab453de57ee84279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60a52ce75b94198ac6abb7727e7072d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:16.939790 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-38f85ebe-3894-4774-aebe-54773b69415d tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7" status: 200 len: 1754 microversion: 2.1 time: 0.186371 Nov 02 14:43:16.940352 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 270/518] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:16 2022] GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7 => generated 1754 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:16.978055 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-6304a369-336f-4bea-9fe0-1fdb49734e98 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:16.978811 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-6304a369-336f-4bea-9fe0-1fdb49734e98 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:16.986128 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6304a369-336f-4bea-9fe0-1fdb49734e98 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:16.986609 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6304a369-336f-4bea-9fe0-1fdb49734e98 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:16.987042 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6304a369-336f-4bea-9fe0-1fdb49734e98 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:16.987736 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6304a369-336f-4bea-9fe0-1fdb49734e98 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:16.988184 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6304a369-336f-4bea-9fe0-1fdb49734e98 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:16.988604 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6304a369-336f-4bea-9fe0-1fdb49734e98 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:17.124391 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-6304a369-336f-4bea-9fe0-1fdb49734e98 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:17.132762 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-6304a369-336f-4bea-9fe0-1fdb49734e98 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91" status: 200 len: 1736 microversion: 2.1 time: 0.158468 Nov 02 14:43:17.133647 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 249/519] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:16 2022] GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:17.963645 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-f410ab26-b999-4a90-9371-84cef946a03c tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:17.964270 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-f410ab26-b999-4a90-9371-84cef946a03c tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:17.971253 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f410ab26-b999-4a90-9371-84cef946a03c tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:17.971757 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f410ab26-b999-4a90-9371-84cef946a03c tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:17.972191 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f410ab26-b999-4a90-9371-84cef946a03c tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:17.972879 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f410ab26-b999-4a90-9371-84cef946a03c tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:17.973374 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f410ab26-b999-4a90-9371-84cef946a03c tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:17.973798 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f410ab26-b999-4a90-9371-84cef946a03c tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:17.977924 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:43:18.119842 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-f410ab26-b999-4a90-9371-84cef946a03c tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cc06a6df04ca4ab453de57ee84279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60a52ce75b94198ac6abb7727e7072d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:18.128765 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-f410ab26-b999-4a90-9371-84cef946a03c tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7" status: 200 len: 1754 microversion: 2.1 time: 0.168885 Nov 02 14:43:18.129366 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 271/520] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:17 2022] GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7 => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:18.155673 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-de0f63e4-bede-4b3b-9459-6a347f66669c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:18.156340 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-de0f63e4-bede-4b3b-9459-6a347f66669c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:18.163322 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-de0f63e4-bede-4b3b-9459-6a347f66669c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:18.163735 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-de0f63e4-bede-4b3b-9459-6a347f66669c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:18.164208 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-de0f63e4-bede-4b3b-9459-6a347f66669c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:18.164927 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-de0f63e4-bede-4b3b-9459-6a347f66669c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:18.165413 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-de0f63e4-bede-4b3b-9459-6a347f66669c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:18.165842 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-de0f63e4-bede-4b3b-9459-6a347f66669c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:18.186517 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:43:18.300837 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-de0f63e4-bede-4b3b-9459-6a347f66669c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:18.309222 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-de0f63e4-bede-4b3b-9459-6a347f66669c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91" status: 200 len: 1736 microversion: 2.1 time: 0.157295 Nov 02 14:43:18.309967 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 250/521] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:18 2022] GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:19.152895 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-78d9b94d-af2c-4e14-8b17-61e4b66eaa1a tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:19.153535 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-78d9b94d-af2c-4e14-8b17-61e4b66eaa1a tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:19.162032 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-78d9b94d-af2c-4e14-8b17-61e4b66eaa1a tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:19.162521 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-78d9b94d-af2c-4e14-8b17-61e4b66eaa1a tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:19.162959 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-78d9b94d-af2c-4e14-8b17-61e4b66eaa1a tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:19.163653 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-78d9b94d-af2c-4e14-8b17-61e4b66eaa1a tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:19.164097 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-78d9b94d-af2c-4e14-8b17-61e4b66eaa1a tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:19.164545 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-78d9b94d-af2c-4e14-8b17-61e4b66eaa1a tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:19.334868 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-b3c9d3cc-430c-42cf-81f8-fc4254e6f4ec tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:19.335469 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-b3c9d3cc-430c-42cf-81f8-fc4254e6f4ec tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:19.342608 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b3c9d3cc-430c-42cf-81f8-fc4254e6f4ec tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:19.343405 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b3c9d3cc-430c-42cf-81f8-fc4254e6f4ec tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:19.344797 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b3c9d3cc-430c-42cf-81f8-fc4254e6f4ec tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:19.346169 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b3c9d3cc-430c-42cf-81f8-fc4254e6f4ec tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:19.361519 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b3c9d3cc-430c-42cf-81f8-fc4254e6f4ec tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:19.361519 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b3c9d3cc-430c-42cf-81f8-fc4254e6f4ec tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:19.630746 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-78d9b94d-af2c-4e14-8b17-61e4b66eaa1a tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cc06a6df04ca4ab453de57ee84279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60a52ce75b94198ac6abb7727e7072d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:19.643139 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-78d9b94d-af2c-4e14-8b17-61e4b66eaa1a tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7" status: 200 len: 1754 microversion: 2.1 time: 0.492128 Nov 02 14:43:19.643815 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 272/522] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:19 2022] GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7 => generated 1754 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:19.727772 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-b3c9d3cc-430c-42cf-81f8-fc4254e6f4ec tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:19.736794 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-b3c9d3cc-430c-42cf-81f8-fc4254e6f4ec tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91" status: 200 len: 1736 microversion: 2.1 time: 0.406259 Nov 02 14:43:19.737407 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 251/523] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:19 2022] GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 => generated 1736 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:20.667438 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-18e1e730-c147-4fff-aefc-52fb158ecac8 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:20.668040 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-18e1e730-c147-4fff-aefc-52fb158ecac8 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:20.675865 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-18e1e730-c147-4fff-aefc-52fb158ecac8 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:20.676359 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-18e1e730-c147-4fff-aefc-52fb158ecac8 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:20.676800 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-18e1e730-c147-4fff-aefc-52fb158ecac8 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:20.677525 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-18e1e730-c147-4fff-aefc-52fb158ecac8 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:20.677980 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-18e1e730-c147-4fff-aefc-52fb158ecac8 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:20.678404 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-18e1e730-c147-4fff-aefc-52fb158ecac8 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:20.761762 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-c504edcb-ebdc-4379-89ec-2ec2149bb1c9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:20.762347 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-c504edcb-ebdc-4379-89ec-2ec2149bb1c9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:20.774100 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c504edcb-ebdc-4379-89ec-2ec2149bb1c9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:20.774678 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c504edcb-ebdc-4379-89ec-2ec2149bb1c9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:20.778268 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c504edcb-ebdc-4379-89ec-2ec2149bb1c9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:20.778268 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c504edcb-ebdc-4379-89ec-2ec2149bb1c9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:20.778268 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c504edcb-ebdc-4379-89ec-2ec2149bb1c9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:20.778268 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c504edcb-ebdc-4379-89ec-2ec2149bb1c9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:20.871211 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-18e1e730-c147-4fff-aefc-52fb158ecac8 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cc06a6df04ca4ab453de57ee84279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60a52ce75b94198ac6abb7727e7072d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:20.880606 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-18e1e730-c147-4fff-aefc-52fb158ecac8 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7" status: 200 len: 1754 microversion: 2.1 time: 0.217098 Nov 02 14:43:20.881939 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 273/524] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:20 2022] GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7 => generated 1754 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:20.939010 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-c504edcb-ebdc-4379-89ec-2ec2149bb1c9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:20.947237 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-c504edcb-ebdc-4379-89ec-2ec2149bb1c9 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91" status: 200 len: 1736 microversion: 2.1 time: 0.189392 Nov 02 14:43:20.951586 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 252/525] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:20 2022] GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 => generated 1736 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:43:21.910127 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-254241eb-fd5e-40fc-8798-b06a84936a25 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:21.910742 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-254241eb-fd5e-40fc-8798-b06a84936a25 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:21.920990 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-254241eb-fd5e-40fc-8798-b06a84936a25 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:21.921521 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-254241eb-fd5e-40fc-8798-b06a84936a25 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:21.922040 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-254241eb-fd5e-40fc-8798-b06a84936a25 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:21.923407 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-254241eb-fd5e-40fc-8798-b06a84936a25 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:21.923883 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-254241eb-fd5e-40fc-8798-b06a84936a25 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:21.924312 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-254241eb-fd5e-40fc-8798-b06a84936a25 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:21.972854 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-0e69f3a9-76ec-4d2a-88e2-3d24f29587d4 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:21.973513 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-0e69f3a9-76ec-4d2a-88e2-3d24f29587d4 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:21.981453 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0e69f3a9-76ec-4d2a-88e2-3d24f29587d4 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:21.981954 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0e69f3a9-76ec-4d2a-88e2-3d24f29587d4 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:21.982596 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0e69f3a9-76ec-4d2a-88e2-3d24f29587d4 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:21.983319 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0e69f3a9-76ec-4d2a-88e2-3d24f29587d4 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:21.983784 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0e69f3a9-76ec-4d2a-88e2-3d24f29587d4 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:21.984467 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0e69f3a9-76ec-4d2a-88e2-3d24f29587d4 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:22.133688 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-254241eb-fd5e-40fc-8798-b06a84936a25 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cc06a6df04ca4ab453de57ee84279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60a52ce75b94198ac6abb7727e7072d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:22.151994 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-254241eb-fd5e-40fc-8798-b06a84936a25 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7" status: 200 len: 1754 microversion: 2.1 time: 0.246504 Nov 02 14:43:22.152579 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 274/526] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:21 2022] GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7 => generated 1754 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:22.165180 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-0e69f3a9-76ec-4d2a-88e2-3d24f29587d4 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:22.174787 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-0e69f3a9-76ec-4d2a-88e2-3d24f29587d4 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91" status: 200 len: 1736 microversion: 2.1 time: 0.206462 Nov 02 14:43:22.174943 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 253/527] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:21 2022] GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 => generated 1736 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:43:23.178234 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-674aa03b-2997-4a83-99b4-4c91bb11ec45 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:23.178783 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-674aa03b-2997-4a83-99b4-4c91bb11ec45 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:23.185479 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-674aa03b-2997-4a83-99b4-4c91bb11ec45 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:23.185966 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-674aa03b-2997-4a83-99b4-4c91bb11ec45 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:23.186404 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-674aa03b-2997-4a83-99b4-4c91bb11ec45 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:23.187110 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-674aa03b-2997-4a83-99b4-4c91bb11ec45 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:23.187609 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-674aa03b-2997-4a83-99b4-4c91bb11ec45 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:23.188639 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-674aa03b-2997-4a83-99b4-4c91bb11ec45 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:23.198205 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-20537472-5d78-42e6-b5b2-618145f2474b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:23.198816 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-20537472-5d78-42e6-b5b2-618145f2474b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:23.205551 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-20537472-5d78-42e6-b5b2-618145f2474b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:23.206047 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-20537472-5d78-42e6-b5b2-618145f2474b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:23.206491 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-20537472-5d78-42e6-b5b2-618145f2474b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:23.207635 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-20537472-5d78-42e6-b5b2-618145f2474b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:23.207635 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-20537472-5d78-42e6-b5b2-618145f2474b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:23.208056 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-20537472-5d78-42e6-b5b2-618145f2474b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:23.414191 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-20537472-5d78-42e6-b5b2-618145f2474b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:23.419510 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-674aa03b-2997-4a83-99b4-4c91bb11ec45 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cc06a6df04ca4ab453de57ee84279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60a52ce75b94198ac6abb7727e7072d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:23.425959 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-20537472-5d78-42e6-b5b2-618145f2474b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91" status: 200 len: 1736 microversion: 2.1 time: 0.231447 Nov 02 14:43:23.427191 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 254/528] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:23 2022] GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 => generated 1736 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:43:23.431238 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-674aa03b-2997-4a83-99b4-4c91bb11ec45 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7" status: 200 len: 1754 microversion: 2.1 time: 0.258113 Nov 02 14:43:23.431895 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 275/529] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:23 2022] GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7 => generated 1754 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:24.450979 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-fe558e6e-9028-4631-a333-d29ab5469381 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:24.451680 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-fe558e6e-9028-4631-a333-d29ab5469381 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:24.455531 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-3c8d8a5c-0ced-452c-ab02-d626ea6cb6a2 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:24.456153 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-3c8d8a5c-0ced-452c-ab02-d626ea6cb6a2 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:24.461373 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-fe558e6e-9028-4631-a333-d29ab5469381 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:24.461373 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-fe558e6e-9028-4631-a333-d29ab5469381 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:24.461373 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-fe558e6e-9028-4631-a333-d29ab5469381 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:24.461674 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-fe558e6e-9028-4631-a333-d29ab5469381 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:24.461909 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-fe558e6e-9028-4631-a333-d29ab5469381 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:24.462445 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-fe558e6e-9028-4631-a333-d29ab5469381 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:24.463924 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3c8d8a5c-0ced-452c-ab02-d626ea6cb6a2 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:24.464418 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3c8d8a5c-0ced-452c-ab02-d626ea6cb6a2 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:24.464876 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3c8d8a5c-0ced-452c-ab02-d626ea6cb6a2 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:24.465626 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3c8d8a5c-0ced-452c-ab02-d626ea6cb6a2 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:24.466085 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3c8d8a5c-0ced-452c-ab02-d626ea6cb6a2 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:24.467779 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3c8d8a5c-0ced-452c-ab02-d626ea6cb6a2 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:24.674319 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-fe558e6e-9028-4631-a333-d29ab5469381 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:24.684038 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-fe558e6e-9028-4631-a333-d29ab5469381 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91" status: 200 len: 1736 microversion: 2.1 time: 0.237430 Nov 02 14:43:24.684770 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 255/530] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:24 2022] GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 => generated 1736 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:24.694944 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-3c8d8a5c-0ced-452c-ab02-d626ea6cb6a2 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cc06a6df04ca4ab453de57ee84279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60a52ce75b94198ac6abb7727e7072d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:24.703358 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-3c8d8a5c-0ced-452c-ab02-d626ea6cb6a2 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7" status: 200 len: 1754 microversion: 2.1 time: 0.252759 Nov 02 14:43:24.703931 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 276/531] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:24 2022] GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7 => generated 1754 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:43:25.709095 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-6735390e-36e7-4809-ac91-744605dc58c6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:25.709719 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-6735390e-36e7-4809-ac91-744605dc58c6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:25.718464 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6735390e-36e7-4809-ac91-744605dc58c6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:25.719657 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6735390e-36e7-4809-ac91-744605dc58c6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:25.720853 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6735390e-36e7-4809-ac91-744605dc58c6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:25.722096 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6735390e-36e7-4809-ac91-744605dc58c6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:25.722568 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6735390e-36e7-4809-ac91-744605dc58c6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:25.723056 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6735390e-36e7-4809-ac91-744605dc58c6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:25.727243 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-c51f5a30-bb80-4393-9bc1-9ec9a31eedca tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:25.728464 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-c51f5a30-bb80-4393-9bc1-9ec9a31eedca tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:25.742946 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c51f5a30-bb80-4393-9bc1-9ec9a31eedca tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:25.743496 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c51f5a30-bb80-4393-9bc1-9ec9a31eedca tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:25.743989 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c51f5a30-bb80-4393-9bc1-9ec9a31eedca tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:25.745868 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c51f5a30-bb80-4393-9bc1-9ec9a31eedca tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:25.745868 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c51f5a30-bb80-4393-9bc1-9ec9a31eedca tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:25.745868 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c51f5a30-bb80-4393-9bc1-9ec9a31eedca tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:25.949976 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-6735390e-36e7-4809-ac91-744605dc58c6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:25.962397 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-6735390e-36e7-4809-ac91-744605dc58c6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91" status: 200 len: 1736 microversion: 2.1 time: 0.256603 Nov 02 14:43:25.963200 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 256/532] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:25 2022] GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 => generated 1736 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:25.972405 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-c51f5a30-bb80-4393-9bc1-9ec9a31eedca tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cc06a6df04ca4ab453de57ee84279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60a52ce75b94198ac6abb7727e7072d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:25.981145 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-c51f5a30-bb80-4393-9bc1-9ec9a31eedca tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7" status: 200 len: 1754 microversion: 2.1 time: 0.257710 Nov 02 14:43:25.981741 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 277/533] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:25 2022] GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7 => generated 1754 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:43:26.986922 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-b40fd323-e2b2-432f-a036-30167437ee41 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:26.987539 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-b40fd323-e2b2-432f-a036-30167437ee41 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:26.989884 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_api:SELECT=42 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:43:26.994511 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b40fd323-e2b2-432f-a036-30167437ee41 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:26.995000 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b40fd323-e2b2-432f-a036-30167437ee41 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:26.995444 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b40fd323-e2b2-432f-a036-30167437ee41 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:26.996155 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b40fd323-e2b2-432f-a036-30167437ee41 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:26.996610 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b40fd323-e2b2-432f-a036-30167437ee41 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:26.997070 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b40fd323-e2b2-432f-a036-30167437ee41 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:27.006876 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-b6b41e16-5fd1-48e3-aaa6-4448208a36b9 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:27.007504 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-b6b41e16-5fd1-48e3-aaa6-4448208a36b9 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:27.013903 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b6b41e16-5fd1-48e3-aaa6-4448208a36b9 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:27.014483 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b6b41e16-5fd1-48e3-aaa6-4448208a36b9 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:27.014915 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b6b41e16-5fd1-48e3-aaa6-4448208a36b9 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:27.015610 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b6b41e16-5fd1-48e3-aaa6-4448208a36b9 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:27.016620 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b6b41e16-5fd1-48e3-aaa6-4448208a36b9 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:27.017076 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b6b41e16-5fd1-48e3-aaa6-4448208a36b9 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:27.200057 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-b40fd323-e2b2-432f-a036-30167437ee41 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:27.210065 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-b40fd323-e2b2-432f-a036-30167437ee41 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91" status: 200 len: 1736 microversion: 2.1 time: 0.227779 Nov 02 14:43:27.210647 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 257/534] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:26 2022] GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 => generated 1736 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:27.222286 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-b6b41e16-5fd1-48e3-aaa6-4448208a36b9 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cc06a6df04ca4ab453de57ee84279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60a52ce75b94198ac6abb7727e7072d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:27.230665 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-b6b41e16-5fd1-48e3-aaa6-4448208a36b9 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7" status: 200 len: 1757 microversion: 2.1 time: 0.227669 Nov 02 14:43:27.236240 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 278/535] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:27 2022] GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7 => generated 1757 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:43:28.234614 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-721f8f96-f498-42f8-a2fb-a8e7c9c73656 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:28.235729 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-721f8f96-f498-42f8-a2fb-a8e7c9c73656 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:28.242366 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-721f8f96-f498-42f8-a2fb-a8e7c9c73656 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:28.242856 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-721f8f96-f498-42f8-a2fb-a8e7c9c73656 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:28.243294 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-721f8f96-f498-42f8-a2fb-a8e7c9c73656 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:28.244001 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-721f8f96-f498-42f8-a2fb-a8e7c9c73656 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:28.244455 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-721f8f96-f498-42f8-a2fb-a8e7c9c73656 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:28.244882 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-721f8f96-f498-42f8-a2fb-a8e7c9c73656 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:28.379455 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-721f8f96-f498-42f8-a2fb-a8e7c9c73656 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:28.387864 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-721f8f96-f498-42f8-a2fb-a8e7c9c73656 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91" status: 200 len: 1736 microversion: 2.1 time: 0.157454 Nov 02 14:43:28.388437 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 258/536] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:28 2022] GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:29.411920 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-7d267b50-3ec4-49f6-b982-784fc56822d1 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:29.412528 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-7d267b50-3ec4-49f6-b982-784fc56822d1 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:29.414936 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_api:SELECT=44 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:43:29.419620 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7d267b50-3ec4-49f6-b982-784fc56822d1 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:29.420078 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7d267b50-3ec4-49f6-b982-784fc56822d1 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:29.420514 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7d267b50-3ec4-49f6-b982-784fc56822d1 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:29.421239 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7d267b50-3ec4-49f6-b982-784fc56822d1 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:29.421711 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7d267b50-3ec4-49f6-b982-784fc56822d1 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:29.422837 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7d267b50-3ec4-49f6-b982-784fc56822d1 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:29.558483 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-7d267b50-3ec4-49f6-b982-784fc56822d1 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:29.566787 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-7d267b50-3ec4-49f6-b982-784fc56822d1 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91" status: 200 len: 1736 microversion: 2.1 time: 0.158730 Nov 02 14:43:29.567354 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 279/537] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:29 2022] GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:43:30.589774 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-f685b398-e2b8-48b7-83a0-1fbabaea542e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:30.590756 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-f685b398-e2b8-48b7-83a0-1fbabaea542e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:30.596933 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f685b398-e2b8-48b7-83a0-1fbabaea542e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:30.599363 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f685b398-e2b8-48b7-83a0-1fbabaea542e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:30.599363 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f685b398-e2b8-48b7-83a0-1fbabaea542e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:30.599363 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f685b398-e2b8-48b7-83a0-1fbabaea542e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:30.599363 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f685b398-e2b8-48b7-83a0-1fbabaea542e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:30.599797 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f685b398-e2b8-48b7-83a0-1fbabaea542e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:30.732058 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-f685b398-e2b8-48b7-83a0-1fbabaea542e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:30.740801 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-f685b398-e2b8-48b7-83a0-1fbabaea542e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91" status: 200 len: 1736 microversion: 2.1 time: 0.155159 Nov 02 14:43:30.741408 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 259/538] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:30 2022] GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:31.783357 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-1cc8ec5a-034b-4829-8363-31258f1ac144 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:31.783357 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-1cc8ec5a-034b-4829-8363-31258f1ac144 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:31.783357 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1cc8ec5a-034b-4829-8363-31258f1ac144 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:31.783357 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1cc8ec5a-034b-4829-8363-31258f1ac144 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:31.784604 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1cc8ec5a-034b-4829-8363-31258f1ac144 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:31.784604 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1cc8ec5a-034b-4829-8363-31258f1ac144 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:31.784604 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1cc8ec5a-034b-4829-8363-31258f1ac144 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:31.784604 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1cc8ec5a-034b-4829-8363-31258f1ac144 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:31.909967 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-1cc8ec5a-034b-4829-8363-31258f1ac144 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:31.918522 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-1cc8ec5a-034b-4829-8363-31258f1ac144 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91" status: 200 len: 1736 microversion: 2.1 time: 0.157356 Nov 02 14:43:31.919082 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 280/539] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:31 2022] GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:32.961642 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-6d10a1d1-6b24-4ef4-8d68-d9fc9d5dc064 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:32.961642 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-6d10a1d1-6b24-4ef4-8d68-d9fc9d5dc064 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:32.961642 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6d10a1d1-6b24-4ef4-8d68-d9fc9d5dc064 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:32.961642 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6d10a1d1-6b24-4ef4-8d68-d9fc9d5dc064 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:32.962483 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6d10a1d1-6b24-4ef4-8d68-d9fc9d5dc064 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:32.962483 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6d10a1d1-6b24-4ef4-8d68-d9fc9d5dc064 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:32.962483 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6d10a1d1-6b24-4ef4-8d68-d9fc9d5dc064 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:32.962483 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6d10a1d1-6b24-4ef4-8d68-d9fc9d5dc064 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:33.084808 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-6d10a1d1-6b24-4ef4-8d68-d9fc9d5dc064 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:33.093192 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-6d10a1d1-6b24-4ef4-8d68-d9fc9d5dc064 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91" status: 200 len: 1716 microversion: 2.1 time: 0.155451 Nov 02 14:43:33.094250 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 260/540] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:32 2022] GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 => generated 1716 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:33.206989 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-d200b364-1e01-4d0a-9ec5-d2e7109b809c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:33.214639 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-d200b364-1e01-4d0a-9ec5-d2e7109b809c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:33.214639 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d200b364-1e01-4d0a-9ec5-d2e7109b809c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:33.215130 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d200b364-1e01-4d0a-9ec5-d2e7109b809c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:33.215567 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d200b364-1e01-4d0a-9ec5-d2e7109b809c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:33.216293 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d200b364-1e01-4d0a-9ec5-d2e7109b809c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:33.216755 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d200b364-1e01-4d0a-9ec5-d2e7109b809c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:33.217216 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d200b364-1e01-4d0a-9ec5-d2e7109b809c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:33.345338 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.wsgi [None req-d200b364-1e01-4d0a-9ec5-d2e7109b809c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] HTTP exception thrown: Cannot 'detach_volume' instance 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 while it is in vm_state rescued Nov 02 14:43:33.347018 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-d200b364-1e01-4d0a-9ec5-d2e7109b809c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Request method failure captured: Nov 02 14:43:33.347018 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: request: DELETE /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91/os-volume_attachments/e390f0c9-4a9d-4e80-b566-bcf86fcd75fa HTTP/1.1 Nov 02 14:43:33.347018 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Accept: application/json Nov 02 14:43:33.347018 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Accept-Encoding: identity Nov 02 14:43:33.347018 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Connection: close Nov 02 14:43:33.347018 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Content-Length: 0 Nov 02 14:43:33.347018 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Content-Type: application/json Nov 02 14:43:33.347018 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Host: 10.222.0.30 Nov 02 14:43:33.347018 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Openstack-System-Scope: None Nov 02 14:43:33.347018 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: User-Agent: python-urllib3/1.26.12 Nov 02 14:43:33.347018 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Auth-Token: gAAAAABjYoEkmtPFFndA3pI-hOMfV7WeoZBKhAJ-580_WIi7mvkfUXB_maVp8Mt8Up4K9l56kfyts_G8Q7rNjcSVvl07EMxmG19Ns5oBN2S0eWoNg7Mp3X9Xfyoe_HCMO3EwwbvsyRXXHW6uAL6g6f3-FqHT3Vo42Jex2zLZydCgw7GbTD2dulA Nov 02 14:43:33.347018 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Domain-Id: None Nov 02 14:43:33.347018 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Domain-Name: None Nov 02 14:43:33.347018 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Identity-Status: Confirmed Nov 02 14:43:33.347018 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Is-Admin-Project: True Nov 02 14:43:33.347018 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Domain-Id: default Nov 02 14:43:33.347018 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Domain-Name: Default Nov 02 14:43:33.347018 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Id: edc675d4a92f4ff9ae8a41a020fa792c Nov 02 14:43:33.347018 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-978907565 Nov 02 14:43:33.347018 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Role: reader,member Nov 02 14:43:33.347018 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Roles: reader,member Nov 02 14:43:33.349634 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/edc675d4a92f4ff9ae8a41a020fa792c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/edc675d4a92f4ff9ae8a41a020fa792c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/edc675d4a92f4ff9ae8a41a020fa792c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_edc675d4a92f4ff9ae8a41a020fa792c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:43:33.349634 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant: tempest-ServerRescueNegativeTestJSON-978907565 Nov 02 14:43:33.349634 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant-Id: edc675d4a92f4ff9ae8a41a020fa792c Nov 02 14:43:33.349634 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-978907565 Nov 02 14:43:33.349634 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User: tempest-ServerRescueNegativeTestJSON-978907565-project Nov 02 14:43:33.349634 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Domain-Id: default Nov 02 14:43:33.349634 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Domain-Name: Default Nov 02 14:43:33.349634 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Id: 921ba33e2e0740278b7b6fb4af248363 Nov 02 14:43:33.349634 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Name: tempest-ServerRescueNegativeTestJSON-978907565-project Nov 02 14:43:33.349634 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: method: > Nov 02 14:43:33.349634 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: exception: Cannot 'detach_volume' instance 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 while it is in vm_state rescued Nov 02 14:43:33.350546 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: action_args: {'server_id': '4d1d6b9a-4ef9-47db-b416-7a0a0f885d91', 'id': 'e390f0c9-4a9d-4e80-b566-bcf86fcd75fa'} Nov 02 14:43:33.350546 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:43:33.350546 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:43:33.350546 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Nov 02 14:43:33.350546 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Nov 02 14:43:33.350546 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 14:43:33.350546 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 14:43:33.350546 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 14:43:33.350546 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 14:43:33.350546 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 in vm_state rescued. Cannot detach_volume while the instance is in this state. Nov 02 14:43:33.350546 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:43:33.350546 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:43:33.350546 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:43:33.350546 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:43:33.350546 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:43:33.350546 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:43:33.350546 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:43:33.350546 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:43:33.350546 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:43:33.350546 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:43:33.352207 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Nov 02 14:43:33.352207 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 14:43:33.352207 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 14:43:33.352207 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 14:43:33.352207 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 while it is in vm_state rescued Nov 02 14:43:33.352207 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:43:33.352207 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:43:33.352207 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:43:33.352207 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:43:33.352207 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:43:33.352207 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:43:33.352207 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:43:33.352207 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:43:33.352207 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 while it is in vm_state rescued Nov 02 14:43:33.352207 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:43:33.352207 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-d200b364-1e01-4d0a-9ec5-d2e7109b809c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Returning 409 to user: Cannot 'detach_volume' instance 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 while it is in vm_state rescued {{(pid=119659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:43:33.353503 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-d200b364-1e01-4d0a-9ec5-d2e7109b809c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91/os-volume_attachments/e390f0c9-4a9d-4e80-b566-bcf86fcd75fa" status: 409 len: 152 microversion: 2.1 time: 0.145772 Nov 02 14:43:33.353503 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 281/541] 10.222.0.30 () {58 vars in 1416 bytes} [Wed Nov 2 14:43:33 2022] DELETE /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91/os-volume_attachments/e390f0c9-4a9d-4e80-b566-bcf86fcd75fa => generated 152 bytes in 147 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 14:43:33.357584 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-12693a1a-b676-4ce6-baa3-3ab05013a46f tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:43:33.358117 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-12693a1a-b676-4ce6-baa3-3ab05013a46f tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:33.364660 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-12693a1a-b676-4ce6-baa3-3ab05013a46f tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:33.365183 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-12693a1a-b676-4ce6-baa3-3ab05013a46f tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:33.365638 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-12693a1a-b676-4ce6-baa3-3ab05013a46f tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:33.366313 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-12693a1a-b676-4ce6-baa3-3ab05013a46f tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:33.366830 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-12693a1a-b676-4ce6-baa3-3ab05013a46f tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:33.367193 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-12693a1a-b676-4ce6-baa3-3ab05013a46f tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:33.579340 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-12693a1a-b676-4ce6-baa3-3ab05013a46f tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "POST /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91/action" status: 202 len: 0 microversion: 2.1 time: 0.224817 Nov 02 14:43:33.579888 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 261/542] 10.222.0.30 () {60 vars in 1278 bytes} [Wed Nov 2 14:43:33 2022] POST /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:43:33.588092 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-2ae56490-2a41-443d-8b16-559974f1f1bc tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:33.589885 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-2ae56490-2a41-443d-8b16-559974f1f1bc tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:33.597163 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2ae56490-2a41-443d-8b16-559974f1f1bc tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:33.597651 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2ae56490-2a41-443d-8b16-559974f1f1bc tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:33.598086 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2ae56490-2a41-443d-8b16-559974f1f1bc tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:33.598781 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2ae56490-2a41-443d-8b16-559974f1f1bc tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:33.599235 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2ae56490-2a41-443d-8b16-559974f1f1bc tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:33.599664 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2ae56490-2a41-443d-8b16-559974f1f1bc tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:33.734870 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-2ae56490-2a41-443d-8b16-559974f1f1bc tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:33.743751 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-2ae56490-2a41-443d-8b16-559974f1f1bc tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91" status: 200 len: 1724 microversion: 2.1 time: 0.159591 Nov 02 14:43:33.744330 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 282/543] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:33 2022] GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:34.770002 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-ba32875c-7756-4ee1-85c1-dd6dacb6acc3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:34.770625 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-ba32875c-7756-4ee1-85c1-dd6dacb6acc3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:34.776810 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ba32875c-7756-4ee1-85c1-dd6dacb6acc3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:34.777339 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ba32875c-7756-4ee1-85c1-dd6dacb6acc3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:34.777783 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ba32875c-7756-4ee1-85c1-dd6dacb6acc3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:34.778492 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ba32875c-7756-4ee1-85c1-dd6dacb6acc3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:34.778948 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ba32875c-7756-4ee1-85c1-dd6dacb6acc3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:34.779378 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ba32875c-7756-4ee1-85c1-dd6dacb6acc3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:34.919196 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-ba32875c-7756-4ee1-85c1-dd6dacb6acc3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:34.927699 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-ba32875c-7756-4ee1-85c1-dd6dacb6acc3 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91" status: 200 len: 1724 microversion: 2.1 time: 0.163649 Nov 02 14:43:34.928283 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 262/544] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:34 2022] GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:35.951774 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-d79a309a-53c2-47b5-a528-e8dddcb1fcf7 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:35.952385 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-d79a309a-53c2-47b5-a528-e8dddcb1fcf7 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:35.960192 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d79a309a-53c2-47b5-a528-e8dddcb1fcf7 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:35.960671 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d79a309a-53c2-47b5-a528-e8dddcb1fcf7 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:35.961134 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d79a309a-53c2-47b5-a528-e8dddcb1fcf7 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:35.961823 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d79a309a-53c2-47b5-a528-e8dddcb1fcf7 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:35.962267 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d79a309a-53c2-47b5-a528-e8dddcb1fcf7 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:35.962678 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d79a309a-53c2-47b5-a528-e8dddcb1fcf7 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:36.095028 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-d79a309a-53c2-47b5-a528-e8dddcb1fcf7 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:36.103268 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-d79a309a-53c2-47b5-a528-e8dddcb1fcf7 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91" status: 200 len: 1724 microversion: 2.1 time: 0.155402 Nov 02 14:43:36.103839 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 283/545] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:35 2022] GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:37.127453 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-4362af4a-0410-41a3-82bb-23e139c7c4a1 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:37.128055 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-4362af4a-0410-41a3-82bb-23e139c7c4a1 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:37.134739 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4362af4a-0410-41a3-82bb-23e139c7c4a1 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:37.135233 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4362af4a-0410-41a3-82bb-23e139c7c4a1 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:37.135664 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4362af4a-0410-41a3-82bb-23e139c7c4a1 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:37.136363 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4362af4a-0410-41a3-82bb-23e139c7c4a1 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:37.136807 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4362af4a-0410-41a3-82bb-23e139c7c4a1 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:37.137354 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4362af4a-0410-41a3-82bb-23e139c7c4a1 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:37.283212 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-4362af4a-0410-41a3-82bb-23e139c7c4a1 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:37.291671 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-4362af4a-0410-41a3-82bb-23e139c7c4a1 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91" status: 200 len: 1724 microversion: 2.1 time: 0.168270 Nov 02 14:43:37.292326 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 263/546] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:37 2022] GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:38.316060 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-1afb5ba3-c3a1-4d96-b5e7-301529672f54 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:38.316669 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-1afb5ba3-c3a1-4d96-b5e7-301529672f54 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:38.323230 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1afb5ba3-c3a1-4d96-b5e7-301529672f54 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:38.323626 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1afb5ba3-c3a1-4d96-b5e7-301529672f54 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:38.324059 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1afb5ba3-c3a1-4d96-b5e7-301529672f54 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:38.324756 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1afb5ba3-c3a1-4d96-b5e7-301529672f54 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:38.325228 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1afb5ba3-c3a1-4d96-b5e7-301529672f54 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:38.325647 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1afb5ba3-c3a1-4d96-b5e7-301529672f54 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:38.461471 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-1afb5ba3-c3a1-4d96-b5e7-301529672f54 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:38.471128 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-1afb5ba3-c3a1-4d96-b5e7-301529672f54 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91" status: 200 len: 1724 microversion: 2.1 time: 0.159408 Nov 02 14:43:38.472119 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 284/547] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:38 2022] GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:39.495396 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-d56059dc-063b-4ab6-b125-cd0f4a6a30c2 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:39.496009 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-d56059dc-063b-4ab6-b125-cd0f4a6a30c2 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:39.503200 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d56059dc-063b-4ab6-b125-cd0f4a6a30c2 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:39.503689 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d56059dc-063b-4ab6-b125-cd0f4a6a30c2 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:39.504131 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d56059dc-063b-4ab6-b125-cd0f4a6a30c2 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:39.504832 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d56059dc-063b-4ab6-b125-cd0f4a6a30c2 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:39.505319 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d56059dc-063b-4ab6-b125-cd0f4a6a30c2 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:39.505756 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d56059dc-063b-4ab6-b125-cd0f4a6a30c2 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:39.646888 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-d56059dc-063b-4ab6-b125-cd0f4a6a30c2 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:39.655138 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-d56059dc-063b-4ab6-b125-cd0f4a6a30c2 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91" status: 200 len: 1730 microversion: 2.1 time: 0.163685 Nov 02 14:43:39.655701 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 264/548] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:39 2022] GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:39.678171 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-1c9d7e92-3de1-4833-811a-f74fb2bacbea tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:39.678822 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-1c9d7e92-3de1-4833-811a-f74fb2bacbea tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:39.685313 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1c9d7e92-3de1-4833-811a-f74fb2bacbea tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:39.685798 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1c9d7e92-3de1-4833-811a-f74fb2bacbea tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:39.686231 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1c9d7e92-3de1-4833-811a-f74fb2bacbea tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:39.686949 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1c9d7e92-3de1-4833-811a-f74fb2bacbea tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:39.688088 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1c9d7e92-3de1-4833-811a-f74fb2bacbea tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:39.688520 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1c9d7e92-3de1-4833-811a-f74fb2bacbea tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:39.770032 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-1c9d7e92-3de1-4833-811a-f74fb2bacbea tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095681 Nov 02 14:43:39.770630 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 285/549] 10.222.0.30 () {58 vars in 1275 bytes} [Wed Nov 2 14:43:39 2022] GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:43:40.713987 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [req-a239173e-7e34-4d83-ae5b-0aba563afbcb req-0c8655fd-9856-40a8-b3c3-e9ffeb8609f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d1d6b9a-4ef9-47db-b416-7a0a0f885d91", "tag": "fc1bebad-c267-4384-b8ba-b3d4c19799bd"}]} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:43:40.724964 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-a239173e-7e34-4d83-ae5b-0aba563afbcb req-0c8655fd-9856-40a8-b3c3-e9ffeb8609f0 service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:40.725574 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-a239173e-7e34-4d83-ae5b-0aba563afbcb req-0c8655fd-9856-40a8-b3c3-e9ffeb8609f0 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:40.726202 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-a239173e-7e34-4d83-ae5b-0aba563afbcb req-0c8655fd-9856-40a8-b3c3-e9ffeb8609f0 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:40.740272 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.compute.server_external_events [req-a239173e-7e34-4d83-ae5b-0aba563afbcb req-0c8655fd-9856-40a8-b3c3-e9ffeb8609f0 service nova] Creating event network-changed:fc1bebad-c267-4384-b8ba-b3d4c19799bd for instance 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 on hv-cinder-86236 Nov 02 14:43:40.746414 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [req-a239173e-7e34-4d83-ae5b-0aba563afbcb req-0c8655fd-9856-40a8-b3c3-e9ffeb8609f0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036293 Nov 02 14:43:40.747375 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 265/550] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:43:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:43:42.762226 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [req-355288e3-85cb-4ea5-83be-cea793a3533c req-5b234a59-7f22-4ebb-ba4a-e7e09d93ba56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d1d6b9a-4ef9-47db-b416-7a0a0f885d91", "tag": "fc1bebad-c267-4384-b8ba-b3d4c19799bd"}]} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:43:42.772123 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-355288e3-85cb-4ea5-83be-cea793a3533c req-5b234a59-7f22-4ebb-ba4a-e7e09d93ba56 service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:42.772592 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-355288e3-85cb-4ea5-83be-cea793a3533c req-5b234a59-7f22-4ebb-ba4a-e7e09d93ba56 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:42.773036 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-355288e3-85cb-4ea5-83be-cea793a3533c req-5b234a59-7f22-4ebb-ba4a-e7e09d93ba56 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:42.784389 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.compute.server_external_events [req-355288e3-85cb-4ea5-83be-cea793a3533c req-5b234a59-7f22-4ebb-ba4a-e7e09d93ba56 service nova] Creating event network-changed:fc1bebad-c267-4384-b8ba-b3d4c19799bd for instance 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 on hv-cinder-86236 Nov 02 14:43:42.789749 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [req-355288e3-85cb-4ea5-83be-cea793a3533c req-5b234a59-7f22-4ebb-ba4a-e7e09d93ba56 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031619 Nov 02 14:43:42.790352 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 286/551] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:43:44.923724 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-94771ff4-e12f-4c53-9ff6-5ea77de986ff tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:44.924440 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-94771ff4-e12f-4c53-9ff6-5ea77de986ff tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:44.931478 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-94771ff4-e12f-4c53-9ff6-5ea77de986ff tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:44.931957 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-94771ff4-e12f-4c53-9ff6-5ea77de986ff tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:44.932387 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-94771ff4-e12f-4c53-9ff6-5ea77de986ff tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:44.933189 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-94771ff4-e12f-4c53-9ff6-5ea77de986ff tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:44.933640 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-94771ff4-e12f-4c53-9ff6-5ea77de986ff tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:44.934061 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-94771ff4-e12f-4c53-9ff6-5ea77de986ff tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:44.963098 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:43:44.967980 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-94771ff4-e12f-4c53-9ff6-5ea77de986ff tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca/os-volume_attachments/af93c542-4ca2-49c5-8c7b-7e5f18f9b83e" status: 200 len: 194 microversion: 2.20 time: 0.049032 Nov 02 14:43:44.968964 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 266/552] 10.222.0.30 () {60 vars in 1454 bytes} [Wed Nov 2 14:43:44 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca/os-volume_attachments/af93c542-4ca2-49c5-8c7b-7e5f18f9b83e => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 14:43:45.042407 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-475830bb-558c-4575-ba86-b817648a374d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:45.042993 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-475830bb-558c-4575-ba86-b817648a374d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:45.050335 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-475830bb-558c-4575-ba86-b817648a374d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:45.050815 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-475830bb-558c-4575-ba86-b817648a374d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:45.051250 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-475830bb-558c-4575-ba86-b817648a374d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:45.051942 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-475830bb-558c-4575-ba86-b817648a374d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:45.052393 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-475830bb-558c-4575-ba86-b817648a374d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:45.052812 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-475830bb-558c-4575-ba86-b817648a374d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:45.141603 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.objects.instance [None req-475830bb-558c-4575-ba86-b817648a374d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lazy-loading 'services' on Instance uuid 5d0f8129-8155-4b7c-a462-f9c067ecfbca {{(pid=119659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:43:45.377104 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-475830bb-558c-4575-ba86-b817648a374d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca/os-volume_attachments/af93c542-4ca2-49c5-8c7b-7e5f18f9b83e" status: 202 len: 0 microversion: 2.20 time: 0.338681 Nov 02 14:43:45.377722 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 287/553] 10.222.0.30 () {60 vars in 1457 bytes} [Wed Nov 2 14:43:45 2022] DELETE /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca/os-volume_attachments/af93c542-4ca2-49c5-8c7b-7e5f18f9b83e => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:43:45.387999 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-6d0d5b13-e137-43bd-84f9-f27e8ec903bd tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:45.391264 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-6d0d5b13-e137-43bd-84f9-f27e8ec903bd tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:45.399059 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6d0d5b13-e137-43bd-84f9-f27e8ec903bd tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:45.399609 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6d0d5b13-e137-43bd-84f9-f27e8ec903bd tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:45.400080 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6d0d5b13-e137-43bd-84f9-f27e8ec903bd tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:45.400853 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6d0d5b13-e137-43bd-84f9-f27e8ec903bd tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:45.401366 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6d0d5b13-e137-43bd-84f9-f27e8ec903bd tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:45.401862 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6d0d5b13-e137-43bd-84f9-f27e8ec903bd tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:45.433220 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-6d0d5b13-e137-43bd-84f9-f27e8ec903bd tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050967 Nov 02 14:43:45.433799 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 267/554] 10.222.0.30 () {60 vars in 1343 bytes} [Wed Nov 2 14:43:45 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 14:43:46.449181 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-5c96b231-5ee5-42cf-8217-427b50acea7c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:46.451446 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-5c96b231-5ee5-42cf-8217-427b50acea7c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:46.458645 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5c96b231-5ee5-42cf-8217-427b50acea7c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:46.459950 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5c96b231-5ee5-42cf-8217-427b50acea7c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:46.459950 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5c96b231-5ee5-42cf-8217-427b50acea7c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:46.460224 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5c96b231-5ee5-42cf-8217-427b50acea7c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:46.460668 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5c96b231-5ee5-42cf-8217-427b50acea7c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:46.461115 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5c96b231-5ee5-42cf-8217-427b50acea7c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:46.465180 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:43:46.491426 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-5c96b231-5ee5-42cf-8217-427b50acea7c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047171 Nov 02 14:43:46.491981 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 288/555] 10.222.0.30 () {60 vars in 1343 bytes} [Wed Nov 2 14:43:46 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 14:43:47.504151 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-dad9e1fe-8aa7-4975-911c-667ff321954c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:47.506410 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-dad9e1fe-8aa7-4975-911c-667ff321954c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:47.514179 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-dad9e1fe-8aa7-4975-911c-667ff321954c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:47.514742 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-dad9e1fe-8aa7-4975-911c-667ff321954c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:47.515148 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-dad9e1fe-8aa7-4975-911c-667ff321954c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:47.515881 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-dad9e1fe-8aa7-4975-911c-667ff321954c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:47.516530 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-dad9e1fe-8aa7-4975-911c-667ff321954c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:47.516973 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-dad9e1fe-8aa7-4975-911c-667ff321954c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:47.550725 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-dad9e1fe-8aa7-4975-911c-667ff321954c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050710 Nov 02 14:43:47.551312 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 268/556] 10.222.0.30 () {60 vars in 1343 bytes} [Wed Nov 2 14:43:47 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:47.625821 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-859a0d65-b16b-45c8-bfba-75c09e69b789 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:47.626415 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-859a0d65-b16b-45c8-bfba-75c09e69b789 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:47.633241 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-859a0d65-b16b-45c8-bfba-75c09e69b789 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:47.633730 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-859a0d65-b16b-45c8-bfba-75c09e69b789 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:47.634166 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-859a0d65-b16b-45c8-bfba-75c09e69b789 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:47.634870 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-859a0d65-b16b-45c8-bfba-75c09e69b789 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:47.635318 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-859a0d65-b16b-45c8-bfba-75c09e69b789 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:47.635744 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-859a0d65-b16b-45c8-bfba-75c09e69b789 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:47.664882 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-859a0d65-b16b-45c8-bfba-75c09e69b789 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Going to try to terminate instance {{(pid=119659) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:43:47.994490 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-859a0d65-b16b-45c8-bfba-75c09e69b789 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 204 len: 0 microversion: 2.20 time: 0.372818 Nov 02 14:43:47.995087 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 289/557] 10.222.0.30 () {60 vars in 1280 bytes} [Wed Nov 2 14:43:47 2022] DELETE /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 02 14:43:48.003611 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-8a6375bf-0b2e-4148-a11c-e583e732e21d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:48.004217 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-8a6375bf-0b2e-4148-a11c-e583e732e21d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:48.010826 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8a6375bf-0b2e-4148-a11c-e583e732e21d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:48.011334 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8a6375bf-0b2e-4148-a11c-e583e732e21d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:48.011752 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8a6375bf-0b2e-4148-a11c-e583e732e21d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:48.012449 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8a6375bf-0b2e-4148-a11c-e583e732e21d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:48.012901 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8a6375bf-0b2e-4148-a11c-e583e732e21d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:48.013355 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8a6375bf-0b2e-4148-a11c-e583e732e21d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:48.156048 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-8a6375bf-0b2e-4148-a11c-e583e732e21d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:48.165729 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-8a6375bf-0b2e-4148-a11c-e583e732e21d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:48.167298 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-8a6375bf-0b2e-4148-a11c-e583e732e21d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:48.168522 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-8a6375bf-0b2e-4148-a11c-e583e732e21d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1724 microversion: 2.20 time: 0.169027 Nov 02 14:43:48.169132 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 269/558] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:43:47 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:43:49.195337 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-9aea5b7b-e4e2-4151-a265-63858d68ac87 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:49.195944 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-9aea5b7b-e4e2-4151-a265-63858d68ac87 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:49.201903 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9aea5b7b-e4e2-4151-a265-63858d68ac87 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:49.202381 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9aea5b7b-e4e2-4151-a265-63858d68ac87 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:49.203331 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9aea5b7b-e4e2-4151-a265-63858d68ac87 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:49.204144 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9aea5b7b-e4e2-4151-a265-63858d68ac87 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:49.204590 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9aea5b7b-e4e2-4151-a265-63858d68ac87 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:49.205032 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9aea5b7b-e4e2-4151-a265-63858d68ac87 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:49.341939 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-9aea5b7b-e4e2-4151-a265-63858d68ac87 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:49.351030 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-9aea5b7b-e4e2-4151-a265-63858d68ac87 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:49.364454 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-9aea5b7b-e4e2-4151-a265-63858d68ac87 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:49.364454 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-9aea5b7b-e4e2-4151-a265-63858d68ac87 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1724 microversion: 2.20 time: 0.163260 Nov 02 14:43:49.364454 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 290/559] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:43:49 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:43:50.387844 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-7ab66a7e-c545-4b50-82b1-8b3a0984e332 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:50.388503 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-7ab66a7e-c545-4b50-82b1-8b3a0984e332 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:50.397041 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7ab66a7e-c545-4b50-82b1-8b3a0984e332 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:50.397041 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7ab66a7e-c545-4b50-82b1-8b3a0984e332 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:50.397041 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7ab66a7e-c545-4b50-82b1-8b3a0984e332 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:50.404246 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7ab66a7e-c545-4b50-82b1-8b3a0984e332 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:50.404246 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7ab66a7e-c545-4b50-82b1-8b3a0984e332 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:50.404246 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7ab66a7e-c545-4b50-82b1-8b3a0984e332 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:50.632121 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-7ab66a7e-c545-4b50-82b1-8b3a0984e332 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:50.650080 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-7ab66a7e-c545-4b50-82b1-8b3a0984e332 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:50.652880 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-7ab66a7e-c545-4b50-82b1-8b3a0984e332 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:50.655058 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-7ab66a7e-c545-4b50-82b1-8b3a0984e332 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1724 microversion: 2.20 time: 0.270873 Nov 02 14:43:50.678290 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 270/560] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:43:50 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1724 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:43:51.129891 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [req-b7a021df-a7eb-42d0-8351-8af1ad095789 req-4809ee85-e616-4de7-b711-3657c223b41d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d0f8129-8155-4b7c-a462-f9c067ecfbca", "name": "network-vif-deleted", "tag": "af3cc54b-a081-4f0c-aad1-a5c16e7530c7"}]} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:43:51.142100 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-b7a021df-a7eb-42d0-8351-8af1ad095789 req-4809ee85-e616-4de7-b711-3657c223b41d service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:51.142594 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-b7a021df-a7eb-42d0-8351-8af1ad095789 req-4809ee85-e616-4de7-b711-3657c223b41d service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:51.143182 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-b7a021df-a7eb-42d0-8351-8af1ad095789 req-4809ee85-e616-4de7-b711-3657c223b41d service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:51.154820 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.compute.server_external_events [req-b7a021df-a7eb-42d0-8351-8af1ad095789 req-4809ee85-e616-4de7-b711-3657c223b41d service nova] Creating event network-vif-deleted:af3cc54b-a081-4f0c-aad1-a5c16e7530c7 for instance 5d0f8129-8155-4b7c-a462-f9c067ecfbca on hv-cinder-86236 Nov 02 14:43:51.160492 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [req-b7a021df-a7eb-42d0-8351-8af1ad095789 req-4809ee85-e616-4de7-b711-3657c223b41d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035650 Nov 02 14:43:51.161172 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 291/561] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:43:51.691517 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-194977e0-ac98-4b40-95b5-a797c6dc66da tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:51.692268 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-194977e0-ac98-4b40-95b5-a797c6dc66da tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:51.699652 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-194977e0-ac98-4b40-95b5-a797c6dc66da tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:51.700476 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-194977e0-ac98-4b40-95b5-a797c6dc66da tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:51.700921 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-194977e0-ac98-4b40-95b5-a797c6dc66da tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:51.701669 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-194977e0-ac98-4b40-95b5-a797c6dc66da tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:51.702128 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-194977e0-ac98-4b40-95b5-a797c6dc66da tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:51.702565 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-194977e0-ac98-4b40-95b5-a797c6dc66da tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:51.738870 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-194977e0-ac98-4b40-95b5-a797c6dc66da tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:51.739382 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-194977e0-ac98-4b40-95b5-a797c6dc66da tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:51.739956 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-194977e0-ac98-4b40-95b5-a797c6dc66da tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:51.740414 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.objects.instance [None req-194977e0-ac98-4b40-95b5-a797c6dc66da tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lazy-loading 'fault' on Instance uuid 5d0f8129-8155-4b7c-a462-f9c067ecfbca {{(pid=119658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:43:51.792439 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-194977e0-ac98-4b40-95b5-a797c6dc66da tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:51.801802 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-194977e0-ac98-4b40-95b5-a797c6dc66da tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:51.803226 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-194977e0-ac98-4b40-95b5-a797c6dc66da tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:51.804369 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-194977e0-ac98-4b40-95b5-a797c6dc66da tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 200 len: 1371 microversion: 2.20 time: 0.117883 Nov 02 14:43:51.804923 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 271/562] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:43:51 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 1371 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:43:52.832313 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-d4def2ba-da88-4270-82d4-a4cdd48db077 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:52.832904 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-d4def2ba-da88-4270-82d4-a4cdd48db077 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:52.839203 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d4def2ba-da88-4270-82d4-a4cdd48db077 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:52.839703 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d4def2ba-da88-4270-82d4-a4cdd48db077 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:52.840134 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d4def2ba-da88-4270-82d4-a4cdd48db077 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:52.840822 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d4def2ba-da88-4270-82d4-a4cdd48db077 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:52.841299 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d4def2ba-da88-4270-82d4-a4cdd48db077 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:52.841722 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d4def2ba-da88-4270-82d4-a4cdd48db077 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:52.858731 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.wsgi [None req-d4def2ba-da88-4270-82d4-a4cdd48db077 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] HTTP exception thrown: Instance 5d0f8129-8155-4b7c-a462-f9c067ecfbca could not be found. Nov 02 14:43:52.860713 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-d4def2ba-da88-4270-82d4-a4cdd48db077 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Request method failure captured: Nov 02 14:43:52.860713 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: request: GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca HTTP/1.1 Nov 02 14:43:52.860713 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Accept: application/json Nov 02 14:43:52.860713 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Accept-Encoding: identity Nov 02 14:43:52.860713 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Connection: close Nov 02 14:43:52.860713 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Content-Length: 0 Nov 02 14:43:52.860713 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Content-Type: application/json Nov 02 14:43:52.860713 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Host: 10.222.0.30 Nov 02 14:43:52.860713 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Openstack-System-Scope: None Nov 02 14:43:52.860713 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: User-Agent: python-urllib3/1.26.12 Nov 02 14:43:52.860713 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Auth-Token: gAAAAABjYoEkFJKJS2lt8KshFJGdx2NEfLWDhPwL4YYGw9SFu0awBIu7966guJpTDjs56OpHNa7daud6PAHKsdpmpdXfOP2zWw0H05_qrMGJfZnWnpj1zak-PExJb8mq2kkTkBHor4I9084tz2329eTNzpWTCNaBl5rtX6JTJptZi_8U-4cw80U Nov 02 14:43:52.860713 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Domain-Id: None Nov 02 14:43:52.860713 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Domain-Name: None Nov 02 14:43:52.860713 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Identity-Status: Confirmed Nov 02 14:43:52.860713 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Is-Admin-Project: True Nov 02 14:43:52.860713 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 14:43:52.860713 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Domain-Id: default Nov 02 14:43:52.860713 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Domain-Name: Default Nov 02 14:43:52.860713 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Id: 0dd67ec4f08d4d548af5b5ccee50407c Nov 02 14:43:52.860713 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1789775418 Nov 02 14:43:52.860713 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Role: reader,member Nov 02 14:43:52.860713 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Roles: reader,member Nov 02 14:43:52.862436 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0dd67ec4f08d4d548af5b5ccee50407c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0dd67ec4f08d4d548af5b5ccee50407c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0dd67ec4f08d4d548af5b5ccee50407c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0dd67ec4f08d4d548af5b5ccee50407c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:43:52.862436 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1789775418 Nov 02 14:43:52.862436 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant-Id: 0dd67ec4f08d4d548af5b5ccee50407c Nov 02 14:43:52.862436 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1789775418 Nov 02 14:43:52.862436 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User: tempest-AttachVolumeShelveTestJSON-1789775418-project Nov 02 14:43:52.862436 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Domain-Id: default Nov 02 14:43:52.862436 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Domain-Name: Default Nov 02 14:43:52.862436 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Id: eb0b112497dc4b64a9ea2f09f808646d Nov 02 14:43:52.862436 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1789775418-project Nov 02 14:43:52.862436 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: method: > Nov 02 14:43:52.862436 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: exception: Instance 5d0f8129-8155-4b7c-a462-f9c067ecfbca could not be found. Nov 02 14:43:52.862436 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: action_args: {'id': '5d0f8129-8155-4b7c-a462-f9c067ecfbca'} Nov 02 14:43:52.863376 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:43:52.863376 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:43:52.863376 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:43:52.863376 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:43:52.863376 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:43:52.863376 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:43:52.863376 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:43:52.863376 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:43:52.863376 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:43:52.863376 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:43:52.863376 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d0f8129-8155-4b7c-a462-f9c067ecfbca could not be found. Nov 02 14:43:52.863376 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:43:52.863376 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:43:52.863376 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:43:52.863376 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:43:52.863376 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:43:52.863376 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:43:52.863376 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:43:52.863376 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:43:52.863376 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:43:52.865312 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:43:52.865312 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:43:52.865312 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:43:52.865312 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:43:52.865312 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:43:52.865312 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:43:52.865312 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:43:52.865312 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d0f8129-8155-4b7c-a462-f9c067ecfbca could not be found. Nov 02 14:43:52.865312 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:43:52.865312 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:43:52.865312 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:43:52.865312 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:43:52.865312 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:43:52.865312 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:43:52.865312 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:43:52.865312 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:43:52.865312 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d0f8129-8155-4b7c-a462-f9c067ecfbca could not be found. Nov 02 14:43:52.865312 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:43:52.866835 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-d4def2ba-da88-4270-82d4-a4cdd48db077 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Returning 404 to user: Instance 5d0f8129-8155-4b7c-a462-f9c067ecfbca could not be found. {{(pid=119659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:43:52.866835 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-d4def2ba-da88-4270-82d4-a4cdd48db077 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 404 len: 111 microversion: 2.20 time: 0.035586 Nov 02 14:43:52.866835 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 292/563] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:43:52 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 14:43:52.871792 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-7ac53dc9-778d-4dba-a14f-3f74bf0cd25a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '.version_select at 0x7fb24ef42670>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:52.956772 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-7ac53dc9-778d-4dba-a14f-3f74bf0cd25a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1913832184" status: 204 len: 0 microversion: 2.20 time: 0.088905 Nov 02 14:43:52.957386 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 272/564] 10.222.0.30 () {60 vars in 1262 bytes} [Wed Nov 2 14:43:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1913832184 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 14:43:53.831819 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-3c0c6418-7cec-4714-87c4-64fcb9c5df5f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Action: 'create', calling method: .version_select at 0x7fb24ed91040>, body: {"keypair": {"name": "tempest-keypair-1231055028", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAyuXXWDrUAUJRmgldXqi0A+tKvTPgK/88hmBbfFOMkPookmwjSXk8DVHpnnblm8apr7fw+0I/eOrY+0y3TiDpVdum6tOWjpAOHOORlylrX9h3962vOG62Ovxjx+74op+Q=="}} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:43:53.852837 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.quota [None req-3c0c6418-7cec-4714-87c4-64fcb9c5df5f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Getting quotas for project 0dd67ec4f08d4d548af5b5ccee50407c. Resources: {'key_pairs'} {{(pid=119659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:43:53.860900 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.quota [None req-3c0c6418-7cec-4714-87c4-64fcb9c5df5f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Getting quotas for user eb0b112497dc4b64a9ea2f09f808646d and project 0dd67ec4f08d4d548af5b5ccee50407c. Resources: {'key_pairs'} {{(pid=119659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:43:53.944185 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-3c0c6418-7cec-4714-87c4-64fcb9c5df5f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.118193 Nov 02 14:43:53.944792 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 293/565] 10.222.0.30 () {62 vars in 1200 bytes} [Wed Nov 2 14:43:53 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 119 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 14:43:56.200783 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-45443782-7a19-46b7-9299-926409ad785a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-838750077", "imageRef": "a726a246-cc7f-46e6-aeff-4d62e03cc091", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f2e46242-b4bc-49aa-9edc-2954b80ac8ba"}], "security_groups": [{"name": "tempest-securitygroup--99597605"}], "key_name": "tempest-keypair-1231055028", "user_data": "}} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:43:56.306621 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.network.neutron [None req-45443782-7a19-46b7-9299-926409ad785a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] validate_networks() for [('f2e46242-b4bc-49aa-9edc-2954b80ac8ba', None, None, None, None, None)] {{(pid=119658) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:43:56.679667 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-45443782-7a19-46b7-9299-926409ad785a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Flavor limits 0:0:0 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:43:56.680100 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-45443782-7a19-46b7-9299-926409ad785a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Image limits 0:0:0 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:43:56.680789 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-45443782-7a19-46b7-9299-926409ad785a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Flavor pref 0:0:0 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:43:56.681022 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-45443782-7a19-46b7-9299-926409ad785a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Image pref 0:0:0 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:43:56.681441 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-45443782-7a19-46b7-9299-926409ad785a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:43:56.690605 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-45443782-7a19-46b7-9299-926409ad785a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:56.691075 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-45443782-7a19-46b7-9299-926409ad785a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:56.691515 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-45443782-7a19-46b7-9299-926409ad785a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:56.692247 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-45443782-7a19-46b7-9299-926409ad785a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:56.692702 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-45443782-7a19-46b7-9299-926409ad785a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:56.693172 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-45443782-7a19-46b7-9299-926409ad785a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:56.710905 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.quota [None req-45443782-7a19-46b7-9299-926409ad785a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Getting quotas for project 0dd67ec4f08d4d548af5b5ccee50407c. Resources: {'instances', 'ram', 'cores'} {{(pid=119658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:43:56.714923 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.quota [None req-45443782-7a19-46b7-9299-926409ad785a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Getting quotas for user eb0b112497dc4b64a9ea2f09f808646d and project 0dd67ec4f08d4d548af5b5ccee50407c. Resources: {'instances', 'ram', 'cores'} {{(pid=119658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:43:56.726884 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-45443782-7a19-46b7-9299-926409ad785a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Going to run 1 instances... {{(pid=119658) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:43:56.729236 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-45443782-7a19-46b7-9299-926409ad785a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a726a246-cc7f-46e6-aeff-4d62e03cc091',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119658) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:43:56.870902 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-45443782-7a19-46b7-9299-926409ad785a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.674341 Nov 02 14:43:56.871568 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 273/566] 10.222.0.30 () {62 vars in 1188 bytes} [Wed Nov 2 14:43:56 2022] POST /compute/v2.1/servers => generated 400 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 14:43:56.883919 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-3e6c31f6-edb6-4327-a38e-9d18b5201b5b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:56.884508 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-3e6c31f6-edb6-4327-a38e-9d18b5201b5b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:56.940926 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-3e6c31f6-edb6-4327-a38e-9d18b5201b5b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:56.948504 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-3e6c31f6-edb6-4327-a38e-9d18b5201b5b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:56.949973 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-3e6c31f6-edb6-4327-a38e-9d18b5201b5b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:56.951051 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-3e6c31f6-edb6-4327-a38e-9d18b5201b5b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0" status: 200 len: 1281 microversion: 2.20 time: 0.071995 Nov 02 14:43:56.951597 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 294/567] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:43:56 2022] GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 => generated 1281 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:43:57.976831 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-e7fbcd08-e9f5-4a2a-8e44-a9328d687c7d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:57.977572 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-e7fbcd08-e9f5-4a2a-8e44-a9328d687c7d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:57.979428 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:43:57.984422 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e7fbcd08-e9f5-4a2a-8e44-a9328d687c7d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:57.986353 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e7fbcd08-e9f5-4a2a-8e44-a9328d687c7d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:57.986353 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e7fbcd08-e9f5-4a2a-8e44-a9328d687c7d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:57.986353 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e7fbcd08-e9f5-4a2a-8e44-a9328d687c7d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:57.986764 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e7fbcd08-e9f5-4a2a-8e44-a9328d687c7d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:57.987192 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e7fbcd08-e9f5-4a2a-8e44-a9328d687c7d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:58.050778 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-e7fbcd08-e9f5-4a2a-8e44-a9328d687c7d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:58.058906 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-e7fbcd08-e9f5-4a2a-8e44-a9328d687c7d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:58.060370 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-e7fbcd08-e9f5-4a2a-8e44-a9328d687c7d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:58.061499 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-e7fbcd08-e9f5-4a2a-8e44-a9328d687c7d tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0" status: 200 len: 1285 microversion: 2.20 time: 0.089128 Nov 02 14:43:58.062585 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 274/568] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:43:57 2022] GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 => generated 1285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:43:59.087810 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-1d03c0a3-b18c-4aa9-a23f-be391caecdd0 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:59.088677 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-1d03c0a3-b18c-4aa9-a23f-be391caecdd0 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:59.095642 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1d03c0a3-b18c-4aa9-a23f-be391caecdd0 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:59.096151 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1d03c0a3-b18c-4aa9-a23f-be391caecdd0 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:59.096579 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1d03c0a3-b18c-4aa9-a23f-be391caecdd0 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:59.097292 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1d03c0a3-b18c-4aa9-a23f-be391caecdd0 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:59.097737 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1d03c0a3-b18c-4aa9-a23f-be391caecdd0 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:59.098156 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1d03c0a3-b18c-4aa9-a23f-be391caecdd0 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:59.188861 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-1d03c0a3-b18c-4aa9-a23f-be391caecdd0 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:59.197401 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-1d03c0a3-b18c-4aa9-a23f-be391caecdd0 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:59.198906 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-1d03c0a3-b18c-4aa9-a23f-be391caecdd0 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:59.200061 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-1d03c0a3-b18c-4aa9-a23f-be391caecdd0 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0" status: 200 len: 1341 microversion: 2.20 time: 0.116564 Nov 02 14:43:59.200838 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 295/569] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:43:59 2022] GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 => generated 1341 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:44:00.226375 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-dc4a0549-f2cc-404b-a26a-cc50777a310a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:00.227547 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-dc4a0549-f2cc-404b-a26a-cc50777a310a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:00.236041 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-dc4a0549-f2cc-404b-a26a-cc50777a310a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:00.236524 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-dc4a0549-f2cc-404b-a26a-cc50777a310a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:00.237181 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-dc4a0549-f2cc-404b-a26a-cc50777a310a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:00.237893 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-dc4a0549-f2cc-404b-a26a-cc50777a310a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:00.238339 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-dc4a0549-f2cc-404b-a26a-cc50777a310a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:00.238923 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-dc4a0549-f2cc-404b-a26a-cc50777a310a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:00.469155 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-dc4a0549-f2cc-404b-a26a-cc50777a310a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:00.478403 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-dc4a0549-f2cc-404b-a26a-cc50777a310a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:00.485875 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-dc4a0549-f2cc-404b-a26a-cc50777a310a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:00.485875 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-dc4a0549-f2cc-404b-a26a-cc50777a310a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0" status: 200 len: 1405 microversion: 2.20 time: 0.258977 Nov 02 14:44:00.485875 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 275/570] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:44:00 2022] GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 => generated 1405 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:44:01.024792 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [req-d4a9992f-dbb2-4ab1-8ca7-69ef06604749 req-478df076-43a4-4eea-a367-c8fa07b490e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea6a4066-de22-411b-9e4b-1531cb199bc0", "tag": "bdb24aef-c8c8-4727-9d59-dbef941eb4f8"}]} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:44:01.031314 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:44:01.036593 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-d4a9992f-dbb2-4ab1-8ca7-69ef06604749 req-478df076-43a4-4eea-a367-c8fa07b490e9 service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:01.037208 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-d4a9992f-dbb2-4ab1-8ca7-69ef06604749 req-478df076-43a4-4eea-a367-c8fa07b490e9 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:01.037722 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-d4a9992f-dbb2-4ab1-8ca7-69ef06604749 req-478df076-43a4-4eea-a367-c8fa07b490e9 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:01.049736 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.compute.server_external_events [req-d4a9992f-dbb2-4ab1-8ca7-69ef06604749 req-478df076-43a4-4eea-a367-c8fa07b490e9 service nova] Creating event network-changed:bdb24aef-c8c8-4727-9d59-dbef941eb4f8 for instance ea6a4066-de22-411b-9e4b-1531cb199bc0 on hv-cinder-86236 Nov 02 14:44:01.054941 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [req-d4a9992f-dbb2-4ab1-8ca7-69ef06604749 req-478df076-43a4-4eea-a367-c8fa07b490e9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033881 Nov 02 14:44:01.055793 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 296/571] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:44:01.507670 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-105bb297-ce50-44f3-aaa7-528d2e8590c1 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:01.508235 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-105bb297-ce50-44f3-aaa7-528d2e8590c1 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:01.515046 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-105bb297-ce50-44f3-aaa7-528d2e8590c1 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:01.515544 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-105bb297-ce50-44f3-aaa7-528d2e8590c1 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:01.516019 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-105bb297-ce50-44f3-aaa7-528d2e8590c1 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:01.516780 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-105bb297-ce50-44f3-aaa7-528d2e8590c1 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:01.517476 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-105bb297-ce50-44f3-aaa7-528d2e8590c1 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:01.517985 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-105bb297-ce50-44f3-aaa7-528d2e8590c1 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:01.705017 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-105bb297-ce50-44f3-aaa7-528d2e8590c1 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:01.713344 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-105bb297-ce50-44f3-aaa7-528d2e8590c1 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:01.714788 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-105bb297-ce50-44f3-aaa7-528d2e8590c1 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:01.715889 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-105bb297-ce50-44f3-aaa7-528d2e8590c1 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0" status: 200 len: 1405 microversion: 2.20 time: 0.212454 Nov 02 14:44:01.716678 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 276/572] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:44:01 2022] GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 => generated 1405 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:44:02.742306 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-7b9b63c0-477d-47b4-92ab-949c21c60666 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:02.742982 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-7b9b63c0-477d-47b4-92ab-949c21c60666 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:02.749539 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7b9b63c0-477d-47b4-92ab-949c21c60666 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:02.750812 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7b9b63c0-477d-47b4-92ab-949c21c60666 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:02.751246 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7b9b63c0-477d-47b4-92ab-949c21c60666 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:02.751924 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7b9b63c0-477d-47b4-92ab-949c21c60666 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:02.752380 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7b9b63c0-477d-47b4-92ab-949c21c60666 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:02.752782 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7b9b63c0-477d-47b4-92ab-949c21c60666 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:02.881233 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-7b9b63c0-477d-47b4-92ab-949c21c60666 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:02.889405 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-7b9b63c0-477d-47b4-92ab-949c21c60666 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:02.891349 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-7b9b63c0-477d-47b4-92ab-949c21c60666 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:02.892635 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-7b9b63c0-477d-47b4-92ab-949c21c60666 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0" status: 200 len: 1405 microversion: 2.20 time: 0.155013 Nov 02 14:44:02.893214 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 297/573] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:44:02 2022] GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:44:03.918709 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-8d28c564-6508-49f4-9841-b1991652102f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:03.919370 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-8d28c564-6508-49f4-9841-b1991652102f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:03.926810 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8d28c564-6508-49f4-9841-b1991652102f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:03.927312 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8d28c564-6508-49f4-9841-b1991652102f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:03.927749 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8d28c564-6508-49f4-9841-b1991652102f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:03.928480 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8d28c564-6508-49f4-9841-b1991652102f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:03.928960 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8d28c564-6508-49f4-9841-b1991652102f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:03.929400 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8d28c564-6508-49f4-9841-b1991652102f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:04.065345 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-8d28c564-6508-49f4-9841-b1991652102f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:04.076670 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-8d28c564-6508-49f4-9841-b1991652102f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:04.078437 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-8d28c564-6508-49f4-9841-b1991652102f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:04.079564 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-8d28c564-6508-49f4-9841-b1991652102f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0" status: 200 len: 1405 microversion: 2.20 time: 0.164894 Nov 02 14:44:04.080128 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 277/574] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:44:03 2022] GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 => generated 1405 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:44:05.105127 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-ee082ad6-7334-4d11-a7de-d5f27c3f18f0 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:05.106401 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-ee082ad6-7334-4d11-a7de-d5f27c3f18f0 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:05.113444 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ee082ad6-7334-4d11-a7de-d5f27c3f18f0 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:05.113923 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ee082ad6-7334-4d11-a7de-d5f27c3f18f0 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:05.114351 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ee082ad6-7334-4d11-a7de-d5f27c3f18f0 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:05.115036 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ee082ad6-7334-4d11-a7de-d5f27c3f18f0 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:05.115479 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ee082ad6-7334-4d11-a7de-d5f27c3f18f0 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:05.115965 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ee082ad6-7334-4d11-a7de-d5f27c3f18f0 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:05.257176 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-ee082ad6-7334-4d11-a7de-d5f27c3f18f0 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:05.266553 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-ee082ad6-7334-4d11-a7de-d5f27c3f18f0 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:05.267703 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-ee082ad6-7334-4d11-a7de-d5f27c3f18f0 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:05.268928 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-ee082ad6-7334-4d11-a7de-d5f27c3f18f0 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0" status: 200 len: 1405 microversion: 2.20 time: 0.167839 Nov 02 14:44:05.269526 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 298/575] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:44:05 2022] GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 => generated 1405 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:44:06.202171 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [req-b7cf1432-2c0b-4ddc-b176-1090c88604a9 req-f3e2d3f1-09ce-4876-bc76-f26bebdf809a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea6a4066-de22-411b-9e4b-1531cb199bc0", "name": "network-vif-plugged", "status": "completed", "tag": "bdb24aef-c8c8-4727-9d59-dbef941eb4f8"}]} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:44:06.213198 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-b7cf1432-2c0b-4ddc-b176-1090c88604a9 req-f3e2d3f1-09ce-4876-bc76-f26bebdf809a service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:06.213679 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-b7cf1432-2c0b-4ddc-b176-1090c88604a9 req-f3e2d3f1-09ce-4876-bc76-f26bebdf809a service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:06.214113 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-b7cf1432-2c0b-4ddc-b176-1090c88604a9 req-f3e2d3f1-09ce-4876-bc76-f26bebdf809a service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:06.225203 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.compute.server_external_events [req-b7cf1432-2c0b-4ddc-b176-1090c88604a9 req-f3e2d3f1-09ce-4876-bc76-f26bebdf809a service nova] Creating event network-vif-plugged:bdb24aef-c8c8-4727-9d59-dbef941eb4f8 for instance ea6a4066-de22-411b-9e4b-1531cb199bc0 on hv-cinder-86236 Nov 02 14:44:06.230723 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [req-b7cf1432-2c0b-4ddc-b176-1090c88604a9 req-f3e2d3f1-09ce-4876-bc76-f26bebdf809a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032032 Nov 02 14:44:06.231303 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 278/576] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:44:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:44:06.294939 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-d8704a1e-3bfa-4f62-8d2a-b8aca7aa9beb tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:06.298930 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-d8704a1e-3bfa-4f62-8d2a-b8aca7aa9beb tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:06.303637 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d8704a1e-3bfa-4f62-8d2a-b8aca7aa9beb tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:06.304123 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d8704a1e-3bfa-4f62-8d2a-b8aca7aa9beb tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:06.304558 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d8704a1e-3bfa-4f62-8d2a-b8aca7aa9beb tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:06.305284 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d8704a1e-3bfa-4f62-8d2a-b8aca7aa9beb tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:06.305736 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d8704a1e-3bfa-4f62-8d2a-b8aca7aa9beb tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:06.306267 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d8704a1e-3bfa-4f62-8d2a-b8aca7aa9beb tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:06.444468 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-d8704a1e-3bfa-4f62-8d2a-b8aca7aa9beb tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:06.452830 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-d8704a1e-3bfa-4f62-8d2a-b8aca7aa9beb tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:06.454804 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-d8704a1e-3bfa-4f62-8d2a-b8aca7aa9beb tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:06.456106 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-d8704a1e-3bfa-4f62-8d2a-b8aca7aa9beb tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0" status: 200 len: 1405 microversion: 2.20 time: 0.166214 Nov 02 14:44:06.456831 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 299/577] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:44:06 2022] GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 => generated 1405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:44:07.044563 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-9c3d7a0b-cc5a-4a19-bd08-c8ee98e57bc3 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-29703795"}} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:44:07.045223 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-9c3d7a0b-cc5a-4a19-bd08-c8ee98e57bc3 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:07.047632 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell0:SELECT=2 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:44:07.048301 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell0:SELECT=6 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:44:07.054041 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9c3d7a0b-cc5a-4a19-bd08-c8ee98e57bc3 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:07.054652 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9c3d7a0b-cc5a-4a19-bd08-c8ee98e57bc3 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:07.058433 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9c3d7a0b-cc5a-4a19-bd08-c8ee98e57bc3 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:07.058433 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9c3d7a0b-cc5a-4a19-bd08-c8ee98e57bc3 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:07.058433 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9c3d7a0b-cc5a-4a19-bd08-c8ee98e57bc3 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:07.058433 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9c3d7a0b-cc5a-4a19-bd08-c8ee98e57bc3 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:07.292086 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.network.security_group_api [None req-9c3d7a0b-cc5a-4a19-bd08-c8ee98e57bc3 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Removing security group fb65d1e8-d64b-4519-9c9f-59355c916132 from port 881c5e7e-3ed6-4eda-ba12-f2fc35e98f97 Nov 02 14:44:07.481222 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-7fa22382-f5d0-484f-855e-1731453f0dee tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:07.481941 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-7fa22382-f5d0-484f-855e-1731453f0dee tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:07.484729 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell0:SELECT=6 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:44:07.490334 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7fa22382-f5d0-484f-855e-1731453f0dee tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:07.491774 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7fa22382-f5d0-484f-855e-1731453f0dee tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:07.491774 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7fa22382-f5d0-484f-855e-1731453f0dee tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:07.491997 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7fa22382-f5d0-484f-855e-1731453f0dee tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:07.492447 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7fa22382-f5d0-484f-855e-1731453f0dee tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:07.492868 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7fa22382-f5d0-484f-855e-1731453f0dee tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:07.695097 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-7fa22382-f5d0-484f-855e-1731453f0dee tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:07.704325 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-7fa22382-f5d0-484f-855e-1731453f0dee tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:07.705980 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-7fa22382-f5d0-484f-855e-1731453f0dee tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:07.713542 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-7fa22382-f5d0-484f-855e-1731453f0dee tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0" status: 200 len: 1405 microversion: 2.20 time: 0.230401 Nov 02 14:44:07.713781 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 300/578] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:44:07 2022] GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 => generated 1405 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:44:07.779761 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-9c3d7a0b-cc5a-4a19-bd08-c8ee98e57bc3 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "POST /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7/action" status: 202 len: 0 microversion: 2.1 time: 0.738880 Nov 02 14:44:07.783734 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 279/579] 10.222.0.30 () {60 vars in 1278 bytes} [Wed Nov 2 14:44:07 2022] POST /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7/action => generated 0 bytes in 744 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:44:07.789360 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [req-a4e38e07-b9ab-4b51-b8e7-b513dea24738 req-b3141300-958e-4489-bfcd-c54334e4cc4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24d10c5a-012e-4d8a-8188-c2289e1605b7", "tag": "881c5e7e-3ed6-4eda-ba12-f2fc35e98f97"}]} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:44:07.799749 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-a4e38e07-b9ab-4b51-b8e7-b513dea24738 req-b3141300-958e-4489-bfcd-c54334e4cc4d service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:07.800137 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-a4e38e07-b9ab-4b51-b8e7-b513dea24738 req-b3141300-958e-4489-bfcd-c54334e4cc4d service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:07.800564 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-a4e38e07-b9ab-4b51-b8e7-b513dea24738 req-b3141300-958e-4489-bfcd-c54334e4cc4d service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:07.814230 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.compute.server_external_events [req-a4e38e07-b9ab-4b51-b8e7-b513dea24738 req-b3141300-958e-4489-bfcd-c54334e4cc4d service nova] Creating event network-changed:881c5e7e-3ed6-4eda-ba12-f2fc35e98f97 for instance 24d10c5a-012e-4d8a-8188-c2289e1605b7 on hv-cinder-86236 Nov 02 14:44:07.819523 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [req-a4e38e07-b9ab-4b51-b8e7-b513dea24738 req-b3141300-958e-4489-bfcd-c54334e4cc4d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033731 Nov 02 14:44:07.819870 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 301/580] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:44:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:44:08.735154 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-5b5d75f9-5802-4b3b-8e74-e798b3831bdc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:08.736095 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-5b5d75f9-5802-4b3b-8e74-e798b3831bdc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:08.742395 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5b5d75f9-5802-4b3b-8e74-e798b3831bdc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:08.742886 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5b5d75f9-5802-4b3b-8e74-e798b3831bdc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:08.743322 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5b5d75f9-5802-4b3b-8e74-e798b3831bdc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:08.744022 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5b5d75f9-5802-4b3b-8e74-e798b3831bdc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:08.744822 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5b5d75f9-5802-4b3b-8e74-e798b3831bdc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:08.745499 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5b5d75f9-5802-4b3b-8e74-e798b3831bdc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:09.002501 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-5b5d75f9-5802-4b3b-8e74-e798b3831bdc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:09.004296 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-57b85250-321e-4644-a824-e9271cb40f9d tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:09.005495 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-57b85250-321e-4644-a824-e9271cb40f9d tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:09.012692 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-57b85250-321e-4644-a824-e9271cb40f9d tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:09.013668 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-57b85250-321e-4644-a824-e9271cb40f9d tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:09.014332 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-57b85250-321e-4644-a824-e9271cb40f9d tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:09.014843 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-5b5d75f9-5802-4b3b-8e74-e798b3831bdc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:09.016024 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-57b85250-321e-4644-a824-e9271cb40f9d tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:09.016777 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-57b85250-321e-4644-a824-e9271cb40f9d tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:09.017283 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-57b85250-321e-4644-a824-e9271cb40f9d tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:09.017975 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-5b5d75f9-5802-4b3b-8e74-e798b3831bdc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:09.019515 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-5b5d75f9-5802-4b3b-8e74-e798b3831bdc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0" status: 200 len: 1597 microversion: 2.20 time: 0.289612 Nov 02 14:44:09.033092 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 280/581] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:44:08 2022] GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 => generated 1597 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:44:09.033092 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [req-742725f3-ceba-44d1-a1ad-9f5eb715f4af req-182b0199-d6e6-44d7-aa1f-98c9672e68f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24d10c5a-012e-4d8a-8188-c2289e1605b7", "tag": "881c5e7e-3ed6-4eda-ba12-f2fc35e98f97"}]} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:44:09.035122 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-742725f3-ceba-44d1-a1ad-9f5eb715f4af req-182b0199-d6e6-44d7-aa1f-98c9672e68f1 service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:09.035645 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-742725f3-ceba-44d1-a1ad-9f5eb715f4af req-182b0199-d6e6-44d7-aa1f-98c9672e68f1 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:09.036082 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-742725f3-ceba-44d1-a1ad-9f5eb715f4af req-182b0199-d6e6-44d7-aa1f-98c9672e68f1 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:09.059506 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.compute.server_external_events [req-742725f3-ceba-44d1-a1ad-9f5eb715f4af req-182b0199-d6e6-44d7-aa1f-98c9672e68f1 service nova] Creating event network-changed:881c5e7e-3ed6-4eda-ba12-f2fc35e98f97 for instance 24d10c5a-012e-4d8a-8188-c2289e1605b7 on hv-cinder-86236 Nov 02 14:44:09.067339 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [req-742725f3-ceba-44d1-a1ad-9f5eb715f4af req-182b0199-d6e6-44d7-aa1f-98c9672e68f1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045713 Nov 02 14:44:09.068303 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 281/582] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:44:09.074844 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-fbb555d2-7b6a-4eac-a70e-2a0c145c4d00 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:09.075584 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-fbb555d2-7b6a-4eac-a70e-2a0c145c4d00 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:09.083828 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-fbb555d2-7b6a-4eac-a70e-2a0c145c4d00 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:09.084330 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-fbb555d2-7b6a-4eac-a70e-2a0c145c4d00 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:09.084775 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-fbb555d2-7b6a-4eac-a70e-2a0c145c4d00 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:09.085548 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-fbb555d2-7b6a-4eac-a70e-2a0c145c4d00 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:09.086227 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-fbb555d2-7b6a-4eac-a70e-2a0c145c4d00 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:09.086682 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-fbb555d2-7b6a-4eac-a70e-2a0c145c4d00 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:09.139003 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.objects.instance [None req-57b85250-321e-4644-a824-e9271cb40f9d tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lazy-loading 'services' on Instance uuid 24d10c5a-012e-4d8a-8188-c2289e1605b7 {{(pid=119659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:44:09.175387 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-fbb555d2-7b6a-4eac-a70e-2a0c145c4d00 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.105818 Nov 02 14:44:09.183525 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 282/583] 10.222.0.30 () {60 vars in 1316 bytes} [Wed Nov 2 14:44:09 2022] GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0/os-interface => generated 285 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 14:44:09.419738 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-57b85250-321e-4644-a824-e9271cb40f9d tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "DELETE /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7/os-volume_attachments/42637ed3-704d-4733-9c6a-e50bc32633fc" status: 202 len: 0 microversion: 2.1 time: 0.421554 Nov 02 14:44:09.421633 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 302/584] 10.222.0.30 () {58 vars in 1416 bytes} [Wed Nov 2 14:44:08 2022] DELETE /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7/os-volume_attachments/42637ed3-704d-4733-9c6a-e50bc32633fc => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:44:09.432348 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-80d6a93f-2334-4acf-9b1c-7d85c1e82f39 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:09.436242 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-80d6a93f-2334-4acf-9b1c-7d85c1e82f39 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:09.444888 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-80d6a93f-2334-4acf-9b1c-7d85c1e82f39 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:09.445673 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-80d6a93f-2334-4acf-9b1c-7d85c1e82f39 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:09.446286 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-80d6a93f-2334-4acf-9b1c-7d85c1e82f39 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:09.447238 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-80d6a93f-2334-4acf-9b1c-7d85c1e82f39 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:09.447699 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-80d6a93f-2334-4acf-9b1c-7d85c1e82f39 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:09.448127 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-80d6a93f-2334-4acf-9b1c-7d85c1e82f39 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:09.484409 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-80d6a93f-2334-4acf-9b1c-7d85c1e82f39 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055937 Nov 02 14:44:09.486564 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 283/585] 10.222.0.30 () {58 vars in 1302 bytes} [Wed Nov 2 14:44:09 2022] GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:44:10.498796 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-1901a4f2-4f03-4cbf-b2a3-12c827c67ef1 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:10.502038 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-1901a4f2-4f03-4cbf-b2a3-12c827c67ef1 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:10.508529 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1901a4f2-4f03-4cbf-b2a3-12c827c67ef1 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:10.509063 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1901a4f2-4f03-4cbf-b2a3-12c827c67ef1 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:10.509455 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1901a4f2-4f03-4cbf-b2a3-12c827c67ef1 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:10.510156 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1901a4f2-4f03-4cbf-b2a3-12c827c67ef1 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:10.510591 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1901a4f2-4f03-4cbf-b2a3-12c827c67ef1 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:10.511097 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1901a4f2-4f03-4cbf-b2a3-12c827c67ef1 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:10.543322 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-1901a4f2-4f03-4cbf-b2a3-12c827c67ef1 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049247 Nov 02 14:44:10.544293 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 303/586] 10.222.0.30 () {58 vars in 1302 bytes} [Wed Nov 2 14:44:10 2022] GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:44:10.568111 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [req-65c73f14-9878-4cb4-9c30-1adeac2cb97a req-ab6a9647-c351-4636-8423-8b5e7c5d7f0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea6a4066-de22-411b-9e4b-1531cb199bc0", "tag": "bdb24aef-c8c8-4727-9d59-dbef941eb4f8"}]} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:44:10.581369 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-65c73f14-9878-4cb4-9c30-1adeac2cb97a req-ab6a9647-c351-4636-8423-8b5e7c5d7f0f service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:10.581369 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-65c73f14-9878-4cb4-9c30-1adeac2cb97a req-ab6a9647-c351-4636-8423-8b5e7c5d7f0f service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:10.581369 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-65c73f14-9878-4cb4-9c30-1adeac2cb97a req-ab6a9647-c351-4636-8423-8b5e7c5d7f0f service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:10.592542 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.compute.server_external_events [req-65c73f14-9878-4cb4-9c30-1adeac2cb97a req-ab6a9647-c351-4636-8423-8b5e7c5d7f0f service nova] Creating event network-changed:bdb24aef-c8c8-4727-9d59-dbef941eb4f8 for instance ea6a4066-de22-411b-9e4b-1531cb199bc0 on hv-cinder-86236 Nov 02 14:44:10.598241 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [req-65c73f14-9878-4cb4-9c30-1adeac2cb97a req-ab6a9647-c351-4636-8423-8b5e7c5d7f0f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033661 Nov 02 14:44:10.599045 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 284/587] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:44:11.556094 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-1f4d96ac-8386-4e60-a2c5-97902decfab6 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:11.558220 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-1f4d96ac-8386-4e60-a2c5-97902decfab6 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:11.565794 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1f4d96ac-8386-4e60-a2c5-97902decfab6 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:11.566362 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1f4d96ac-8386-4e60-a2c5-97902decfab6 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:11.566871 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1f4d96ac-8386-4e60-a2c5-97902decfab6 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:11.567644 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1f4d96ac-8386-4e60-a2c5-97902decfab6 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:11.568193 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1f4d96ac-8386-4e60-a2c5-97902decfab6 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:11.568692 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1f4d96ac-8386-4e60-a2c5-97902decfab6 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:11.599307 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-1f4d96ac-8386-4e60-a2c5-97902decfab6 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047084 Nov 02 14:44:11.599788 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 304/588] 10.222.0.30 () {58 vars in 1302 bytes} [Wed Nov 2 14:44:11 2022] GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 14:44:11.612586 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-7b49b6e8-2085-4001-89d0-aca367affa42 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:11.613797 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-7b49b6e8-2085-4001-89d0-aca367affa42 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:11.620045 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7b49b6e8-2085-4001-89d0-aca367affa42 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:11.620527 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7b49b6e8-2085-4001-89d0-aca367affa42 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:11.620961 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7b49b6e8-2085-4001-89d0-aca367affa42 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:11.621678 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7b49b6e8-2085-4001-89d0-aca367affa42 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:11.622146 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7b49b6e8-2085-4001-89d0-aca367affa42 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:11.622566 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7b49b6e8-2085-4001-89d0-aca367affa42 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:11.748409 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.wsgi [None req-7b49b6e8-2085-4001-89d0-aca367affa42 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] HTTP exception thrown: Instance 24d10c5a-012e-4d8a-8188-c2289e1605b7 is not attached to volume 42637ed3-704d-4733-9c6a-e50bc32633fc Nov 02 14:44:11.756293 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-7b49b6e8-2085-4001-89d0-aca367affa42 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Request method failure captured: Nov 02 14:44:11.756293 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: request: DELETE /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7/os-volume_attachments/42637ed3-704d-4733-9c6a-e50bc32633fc HTTP/1.1 Nov 02 14:44:11.756293 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Accept: application/json Nov 02 14:44:11.756293 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Accept-Encoding: identity Nov 02 14:44:11.756293 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Connection: close Nov 02 14:44:11.756293 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Content-Length: 0 Nov 02 14:44:11.756293 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Content-Type: application/json Nov 02 14:44:11.756293 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Host: 10.222.0.30 Nov 02 14:44:11.756293 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Openstack-System-Scope: None Nov 02 14:44:11.756293 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: User-Agent: python-urllib3/1.26.12 Nov 02 14:44:11.756293 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Auth-Token: gAAAAABjYoGML89U7QYcR-GDRV6edD0M-8LrHIPNzdamqkJ0v32gW3ShLCECk-_v-mHWfOllx9Pc9TNASR1bSsnvydBZTvAQgXgBOtp-OQwfHAgbqiPFpF3gg5vIm-L0cGLelPu3n5bFrwv7WIjWjj5SrlsK5fJ5N_nQn0Muz03a5KuNOtuTMVs Nov 02 14:44:11.756293 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Domain-Id: None Nov 02 14:44:11.756293 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Domain-Name: None Nov 02 14:44:11.756293 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Identity-Status: Confirmed Nov 02 14:44:11.756293 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Is-Admin-Project: True Nov 02 14:44:11.756293 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Domain-Id: default Nov 02 14:44:11.756293 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Domain-Name: Default Nov 02 14:44:11.756293 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Id: e60a52ce75b94198ac6abb7727e7072d Nov 02 14:44:11.756293 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Name: tempest-TestMinimumBasicScenario-501887396 Nov 02 14:44:11.756293 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Role: reader,member Nov 02 14:44:11.756293 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Roles: reader,member Nov 02 14:44:11.759206 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e60a52ce75b94198ac6abb7727e7072d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e60a52ce75b94198ac6abb7727e7072d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e60a52ce75b94198ac6abb7727e7072d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e60a52ce75b94198ac6abb7727e7072d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:44:11.759206 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant: tempest-TestMinimumBasicScenario-501887396 Nov 02 14:44:11.759206 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant-Id: e60a52ce75b94198ac6abb7727e7072d Nov 02 14:44:11.759206 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant-Name: tempest-TestMinimumBasicScenario-501887396 Nov 02 14:44:11.759206 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User: tempest-TestMinimumBasicScenario-501887396-project Nov 02 14:44:11.759206 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Domain-Id: default Nov 02 14:44:11.759206 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Domain-Name: Default Nov 02 14:44:11.759206 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Id: 277cc06a6df04ca4ab453de57ee84279 Nov 02 14:44:11.759206 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Name: tempest-TestMinimumBasicScenario-501887396-project Nov 02 14:44:11.759206 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: method: > Nov 02 14:44:11.759206 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: exception: Instance 24d10c5a-012e-4d8a-8188-c2289e1605b7 is not attached to volume 42637ed3-704d-4733-9c6a-e50bc32633fc Nov 02 14:44:11.760469 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: action_args: {'server_id': '24d10c5a-012e-4d8a-8188-c2289e1605b7', 'id': '42637ed3-704d-4733-9c6a-e50bc32633fc'} Nov 02 14:44:11.760469 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:44:11.760469 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:44:11.760469 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Nov 02 14:44:11.760469 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Nov 02 14:44:11.760469 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 14:44:11.760469 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 14:44:11.760469 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Nov 02 14:44:11.760469 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Nov 02 14:44:11.760469 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 42637ed3-704d-4733-9c6a-e50bc32633fc. Nov 02 14:44:11.760469 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:44:11.760469 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:44:11.760469 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:44:11.760469 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:44:11.760469 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:44:11.760469 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:44:11.760469 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:44:11.760469 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:44:11.760469 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:44:11.761827 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:44:11.761827 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Nov 02 14:44:11.761827 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 14:44:11.761827 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24d10c5a-012e-4d8a-8188-c2289e1605b7 is not attached to volume 42637ed3-704d-4733-9c6a-e50bc32633fc Nov 02 14:44:11.761827 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:44:11.761827 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:44:11.761827 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:44:11.761827 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:44:11.761827 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:44:11.761827 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:44:11.761827 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:44:11.761827 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:44:11.761827 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24d10c5a-012e-4d8a-8188-c2289e1605b7 is not attached to volume 42637ed3-704d-4733-9c6a-e50bc32633fc Nov 02 14:44:11.761827 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:44:11.761827 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-7b49b6e8-2085-4001-89d0-aca367affa42 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Returning 404 to user: Instance 24d10c5a-012e-4d8a-8188-c2289e1605b7 is not attached to volume 42637ed3-704d-4733-9c6a-e50bc32633fc {{(pid=119658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:44:11.763155 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-7b49b6e8-2085-4001-89d0-aca367affa42 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "DELETE /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7/os-volume_attachments/42637ed3-704d-4733-9c6a-e50bc32633fc" status: 404 len: 154 microversion: 2.1 time: 0.151682 Nov 02 14:44:11.763155 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 285/589] 10.222.0.30 () {58 vars in 1416 bytes} [Wed Nov 2 14:44:11 2022] DELETE /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7/os-volume_attachments/42637ed3-704d-4733-9c6a-e50bc32633fc => generated 154 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:44:13.062694 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-2756c7c3-272f-467c-a3c3-d309550ca472 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:13.063206 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-2756c7c3-272f-467c-a3c3-d309550ca472 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:13.069729 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2756c7c3-272f-467c-a3c3-d309550ca472 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:13.070211 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2756c7c3-272f-467c-a3c3-d309550ca472 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:13.070647 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2756c7c3-272f-467c-a3c3-d309550ca472 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:13.071333 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2756c7c3-272f-467c-a3c3-d309550ca472 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:13.071786 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2756c7c3-272f-467c-a3c3-d309550ca472 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:13.072214 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2756c7c3-272f-467c-a3c3-d309550ca472 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:13.096825 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-2756c7c3-272f-467c-a3c3-d309550ca472 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Going to try to terminate instance {{(pid=119659) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:44:13.228786 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:44:13.412855 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-2756c7c3-272f-467c-a3c3-d309550ca472 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "DELETE /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7" status: 204 len: 0 microversion: 2.1 time: 0.353431 Nov 02 14:44:13.413643 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 305/590] 10.222.0.30 () {58 vars in 1239 bytes} [Wed Nov 2 14:44:13 2022] DELETE /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:44:13.421941 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-770c20cc-4423-42cb-bf2c-4a30a5fb0141 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:13.422556 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-770c20cc-4423-42cb-bf2c-4a30a5fb0141 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:13.429055 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-770c20cc-4423-42cb-bf2c-4a30a5fb0141 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:13.429544 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-770c20cc-4423-42cb-bf2c-4a30a5fb0141 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:13.429983 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-770c20cc-4423-42cb-bf2c-4a30a5fb0141 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:13.430678 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-770c20cc-4423-42cb-bf2c-4a30a5fb0141 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:13.431128 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-770c20cc-4423-42cb-bf2c-4a30a5fb0141 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:13.431551 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-770c20cc-4423-42cb-bf2c-4a30a5fb0141 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:13.568401 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-770c20cc-4423-42cb-bf2c-4a30a5fb0141 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cc06a6df04ca4ab453de57ee84279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60a52ce75b94198ac6abb7727e7072d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:13.576113 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-770c20cc-4423-42cb-bf2c-4a30a5fb0141 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7" status: 200 len: 1554 microversion: 2.1 time: 0.158007 Nov 02 14:44:13.576674 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 286/591] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:44:13 2022] GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:14.600178 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-c98fe92e-9353-40ed-87df-fbab82ff2249 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:14.600876 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-c98fe92e-9353-40ed-87df-fbab82ff2249 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:14.607300 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c98fe92e-9353-40ed-87df-fbab82ff2249 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:14.607782 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c98fe92e-9353-40ed-87df-fbab82ff2249 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:14.608301 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c98fe92e-9353-40ed-87df-fbab82ff2249 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:14.609129 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c98fe92e-9353-40ed-87df-fbab82ff2249 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:14.609854 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c98fe92e-9353-40ed-87df-fbab82ff2249 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:14.610287 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c98fe92e-9353-40ed-87df-fbab82ff2249 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:14.738608 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-c98fe92e-9353-40ed-87df-fbab82ff2249 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cc06a6df04ca4ab453de57ee84279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60a52ce75b94198ac6abb7727e7072d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:14.746297 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-c98fe92e-9353-40ed-87df-fbab82ff2249 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7" status: 200 len: 1554 microversion: 2.1 time: 0.150323 Nov 02 14:44:14.746859 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 306/592] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:44:14 2022] GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:15.770415 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-6fbe1649-94e6-4945-97e5-979924549739 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:15.771107 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-6fbe1649-94e6-4945-97e5-979924549739 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:15.778271 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6fbe1649-94e6-4945-97e5-979924549739 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:15.778767 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6fbe1649-94e6-4945-97e5-979924549739 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:15.779221 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6fbe1649-94e6-4945-97e5-979924549739 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:15.779930 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6fbe1649-94e6-4945-97e5-979924549739 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:15.780381 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6fbe1649-94e6-4945-97e5-979924549739 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:15.780942 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6fbe1649-94e6-4945-97e5-979924549739 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:15.802604 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell1:SELECT=100 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:44:16.114828 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-6fbe1649-94e6-4945-97e5-979924549739 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cc06a6df04ca4ab453de57ee84279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60a52ce75b94198ac6abb7727e7072d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:16.123413 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-6fbe1649-94e6-4945-97e5-979924549739 tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7" status: 200 len: 1554 microversion: 2.1 time: 0.356232 Nov 02 14:44:16.123959 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 287/593] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:44:15 2022] GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7 => generated 1554 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:16.334989 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [req-d935a8dc-c3bb-42f1-b079-7d9290cece48 req-edfe186e-19a2-43b8-a133-6a9ea4d3b446 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24d10c5a-012e-4d8a-8188-c2289e1605b7", "name": "network-vif-deleted", "tag": "881c5e7e-3ed6-4eda-ba12-f2fc35e98f97"}]} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:44:16.344448 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-d935a8dc-c3bb-42f1-b079-7d9290cece48 req-edfe186e-19a2-43b8-a133-6a9ea4d3b446 service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:16.344922 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-d935a8dc-c3bb-42f1-b079-7d9290cece48 req-edfe186e-19a2-43b8-a133-6a9ea4d3b446 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:16.345402 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-d935a8dc-c3bb-42f1-b079-7d9290cece48 req-edfe186e-19a2-43b8-a133-6a9ea4d3b446 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:16.356666 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.compute.server_external_events [req-d935a8dc-c3bb-42f1-b079-7d9290cece48 req-edfe186e-19a2-43b8-a133-6a9ea4d3b446 service nova] Creating event network-vif-deleted:881c5e7e-3ed6-4eda-ba12-f2fc35e98f97 for instance 24d10c5a-012e-4d8a-8188-c2289e1605b7 on hv-cinder-86236 Nov 02 14:44:16.362684 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [req-d935a8dc-c3bb-42f1-b079-7d9290cece48 req-edfe186e-19a2-43b8-a133-6a9ea4d3b446 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031619 Nov 02 14:44:16.363358 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 307/594] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:44:17.147507 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-8a720566-5a88-4782-a57a-fcd34ca6542d tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:17.150882 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-8a720566-5a88-4782-a57a-fcd34ca6542d tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:17.155070 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8a720566-5a88-4782-a57a-fcd34ca6542d tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:17.156176 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8a720566-5a88-4782-a57a-fcd34ca6542d tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:17.156603 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8a720566-5a88-4782-a57a-fcd34ca6542d tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:17.157318 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8a720566-5a88-4782-a57a-fcd34ca6542d tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:17.157816 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8a720566-5a88-4782-a57a-fcd34ca6542d tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:17.158235 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8a720566-5a88-4782-a57a-fcd34ca6542d tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:17.188772 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8a720566-5a88-4782-a57a-fcd34ca6542d tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:17.189313 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8a720566-5a88-4782-a57a-fcd34ca6542d tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:17.189758 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8a720566-5a88-4782-a57a-fcd34ca6542d tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:17.190206 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.objects.instance [None req-8a720566-5a88-4782-a57a-fcd34ca6542d tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lazy-loading 'fault' on Instance uuid 24d10c5a-012e-4d8a-8188-c2289e1605b7 {{(pid=119658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:44:17.231820 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-8a720566-5a88-4782-a57a-fcd34ca6542d tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277cc06a6df04ca4ab453de57ee84279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60a52ce75b94198ac6abb7727e7072d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:17.240508 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-8a720566-5a88-4782-a57a-fcd34ca6542d tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7" status: 200 len: 1348 microversion: 2.1 time: 0.096859 Nov 02 14:44:17.241110 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 288/595] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:44:17 2022] GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7 => generated 1348 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:18.266180 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-67f79de0-e6be-489f-94fe-8cc44f96bc7c tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:18.266821 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-67f79de0-e6be-489f-94fe-8cc44f96bc7c tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] [instance: 24d10c5a-012e-4d8a-8188-c2289e1605b7] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:18.272904 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-67f79de0-e6be-489f-94fe-8cc44f96bc7c tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:18.273404 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-67f79de0-e6be-489f-94fe-8cc44f96bc7c tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:18.273829 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-67f79de0-e6be-489f-94fe-8cc44f96bc7c tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:18.274501 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-67f79de0-e6be-489f-94fe-8cc44f96bc7c tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:18.274941 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-67f79de0-e6be-489f-94fe-8cc44f96bc7c tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:18.275352 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-67f79de0-e6be-489f-94fe-8cc44f96bc7c tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:18.288331 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.wsgi [None req-67f79de0-e6be-489f-94fe-8cc44f96bc7c tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] HTTP exception thrown: Instance 24d10c5a-012e-4d8a-8188-c2289e1605b7 could not be found. Nov 02 14:44:18.289964 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-67f79de0-e6be-489f-94fe-8cc44f96bc7c tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Request method failure captured: Nov 02 14:44:18.289964 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: request: GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7 HTTP/1.1 Nov 02 14:44:18.289964 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Accept: application/json Nov 02 14:44:18.289964 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Accept-Encoding: identity Nov 02 14:44:18.289964 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Connection: close Nov 02 14:44:18.289964 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Content-Length: 0 Nov 02 14:44:18.289964 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Content-Type: application/json Nov 02 14:44:18.289964 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Host: 10.222.0.30 Nov 02 14:44:18.289964 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Openstack-System-Scope: None Nov 02 14:44:18.289964 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: User-Agent: python-urllib3/1.26.12 Nov 02 14:44:18.289964 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Auth-Token: gAAAAABjYoGML89U7QYcR-GDRV6edD0M-8LrHIPNzdamqkJ0v32gW3ShLCECk-_v-mHWfOllx9Pc9TNASR1bSsnvydBZTvAQgXgBOtp-OQwfHAgbqiPFpF3gg5vIm-L0cGLelPu3n5bFrwv7WIjWjj5SrlsK5fJ5N_nQn0Muz03a5KuNOtuTMVs Nov 02 14:44:18.289964 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Domain-Id: None Nov 02 14:44:18.289964 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Domain-Name: None Nov 02 14:44:18.289964 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Identity-Status: Confirmed Nov 02 14:44:18.289964 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Is-Admin-Project: True Nov 02 14:44:18.289964 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Domain-Id: default Nov 02 14:44:18.289964 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Domain-Name: Default Nov 02 14:44:18.289964 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Id: e60a52ce75b94198ac6abb7727e7072d Nov 02 14:44:18.289964 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Name: tempest-TestMinimumBasicScenario-501887396 Nov 02 14:44:18.289964 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Role: reader,member Nov 02 14:44:18.289964 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Roles: reader,member Nov 02 14:44:18.291645 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e60a52ce75b94198ac6abb7727e7072d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e60a52ce75b94198ac6abb7727e7072d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e60a52ce75b94198ac6abb7727e7072d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e60a52ce75b94198ac6abb7727e7072d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:44:18.291645 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant: tempest-TestMinimumBasicScenario-501887396 Nov 02 14:44:18.291645 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant-Id: e60a52ce75b94198ac6abb7727e7072d Nov 02 14:44:18.291645 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant-Name: tempest-TestMinimumBasicScenario-501887396 Nov 02 14:44:18.291645 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User: tempest-TestMinimumBasicScenario-501887396-project Nov 02 14:44:18.291645 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Domain-Id: default Nov 02 14:44:18.291645 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Domain-Name: Default Nov 02 14:44:18.291645 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Id: 277cc06a6df04ca4ab453de57ee84279 Nov 02 14:44:18.291645 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Name: tempest-TestMinimumBasicScenario-501887396-project Nov 02 14:44:18.291645 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: method: > Nov 02 14:44:18.291645 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: exception: Instance 24d10c5a-012e-4d8a-8188-c2289e1605b7 could not be found. Nov 02 14:44:18.291645 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: action_args: {'id': '24d10c5a-012e-4d8a-8188-c2289e1605b7'} Nov 02 14:44:18.292551 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:44:18.292551 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:44:18.292551 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:44:18.292551 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:44:18.292551 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:44:18.292551 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:44:18.292551 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:44:18.292551 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:44:18.292551 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:44:18.292551 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:44:18.292551 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24d10c5a-012e-4d8a-8188-c2289e1605b7 could not be found. Nov 02 14:44:18.292551 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:44:18.292551 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:44:18.292551 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:44:18.292551 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:44:18.292551 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:44:18.292551 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:44:18.292551 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:44:18.292551 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:44:18.292551 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:44:18.294041 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:44:18.294041 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:44:18.294041 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:44:18.294041 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:44:18.294041 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:44:18.294041 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:44:18.294041 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:44:18.294041 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24d10c5a-012e-4d8a-8188-c2289e1605b7 could not be found. Nov 02 14:44:18.294041 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:44:18.294041 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:44:18.294041 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:44:18.294041 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:44:18.294041 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:44:18.294041 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:44:18.294041 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:44:18.294041 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:44:18.294041 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24d10c5a-012e-4d8a-8188-c2289e1605b7 could not be found. Nov 02 14:44:18.294041 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:44:18.295467 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-67f79de0-e6be-489f-94fe-8cc44f96bc7c tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Returning 404 to user: Instance 24d10c5a-012e-4d8a-8188-c2289e1605b7 could not be found. {{(pid=119659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:44:18.295467 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-67f79de0-e6be-489f-94fe-8cc44f96bc7c tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7" status: 404 len: 111 microversion: 2.1 time: 0.030724 Nov 02 14:44:18.295467 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 308/596] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:44:18 2022] GET /compute/v2.1/servers/24d10c5a-012e-4d8a-8188-c2289e1605b7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:44:18.299973 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-d21bc059-c2f6-42fe-848e-0095a18c790a tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] Calling method '.version_select at 0x7fb24ee75f70>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:18.387720 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-d21bc059-c2f6-42fe-848e-0095a18c790a tempest-TestMinimumBasicScenario-501887396 tempest-TestMinimumBasicScenario-501887396-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-755497176" status: 202 len: 0 microversion: 2.1 time: 0.091544 Nov 02 14:44:18.388290 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 289/597] 10.222.0.30 () {58 vars in 1269 bytes} [Wed Nov 2 14:44:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-755497176 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:44:20.456917 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-3d9b1592-879a-469e-b159-4f0f3ee8fefe tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:20.457558 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-3d9b1592-879a-469e-b159-4f0f3ee8fefe tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:20.464240 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3d9b1592-879a-469e-b159-4f0f3ee8fefe tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:20.464802 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3d9b1592-879a-469e-b159-4f0f3ee8fefe tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:20.472212 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3d9b1592-879a-469e-b159-4f0f3ee8fefe tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:20.472212 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3d9b1592-879a-469e-b159-4f0f3ee8fefe tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:20.472212 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3d9b1592-879a-469e-b159-4f0f3ee8fefe tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:20.472212 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3d9b1592-879a-469e-b159-4f0f3ee8fefe tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:20.726698 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.objects.instance [None req-3d9b1592-879a-469e-b159-4f0f3ee8fefe tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lazy-loading 'services' on Instance uuid 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 {{(pid=119659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:44:20.943290 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-3d9b1592-879a-469e-b159-4f0f3ee8fefe tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91/os-volume_attachments/e390f0c9-4a9d-4e80-b566-bcf86fcd75fa" status: 202 len: 0 microversion: 2.1 time: 0.492047 Nov 02 14:44:20.944205 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 309/598] 10.222.0.30 () {58 vars in 1416 bytes} [Wed Nov 2 14:44:20 2022] DELETE /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91/os-volume_attachments/e390f0c9-4a9d-4e80-b566-bcf86fcd75fa => generated 0 bytes in 494 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:44:20.955860 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-7b57302a-db82-4fb8-b232-eca1560aba24 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:20.959065 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-7b57302a-db82-4fb8-b232-eca1560aba24 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:20.971308 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7b57302a-db82-4fb8-b232-eca1560aba24 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:20.972091 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7b57302a-db82-4fb8-b232-eca1560aba24 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:20.972547 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7b57302a-db82-4fb8-b232-eca1560aba24 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:20.973308 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7b57302a-db82-4fb8-b232-eca1560aba24 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:20.973936 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7b57302a-db82-4fb8-b232-eca1560aba24 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:20.981325 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7b57302a-db82-4fb8-b232-eca1560aba24 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:21.008767 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-7b57302a-db82-4fb8-b232-eca1560aba24 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058815 Nov 02 14:44:21.009591 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 290/599] 10.222.0.30 () {58 vars in 1302 bytes} [Wed Nov 2 14:44:20 2022] GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:44:22.023396 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-2e0badea-1890-482b-ba2b-cbca33985b1b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:22.025837 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-2e0badea-1890-482b-ba2b-cbca33985b1b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:22.033604 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2e0badea-1890-482b-ba2b-cbca33985b1b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:22.034090 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2e0badea-1890-482b-ba2b-cbca33985b1b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:22.034527 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2e0badea-1890-482b-ba2b-cbca33985b1b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:22.035225 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2e0badea-1890-482b-ba2b-cbca33985b1b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:22.035673 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2e0badea-1890-482b-ba2b-cbca33985b1b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:22.036099 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2e0badea-1890-482b-ba2b-cbca33985b1b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:22.073760 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-2e0badea-1890-482b-ba2b-cbca33985b1b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055218 Nov 02 14:44:22.075039 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 310/600] 10.222.0.30 () {58 vars in 1302 bytes} [Wed Nov 2 14:44:22 2022] GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:44:23.088322 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-2199e06d-4f5f-4739-823f-665d6c398e3e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:23.090673 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-2199e06d-4f5f-4739-823f-665d6c398e3e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:23.097883 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2199e06d-4f5f-4739-823f-665d6c398e3e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:23.098450 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2199e06d-4f5f-4739-823f-665d6c398e3e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:23.098986 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2199e06d-4f5f-4739-823f-665d6c398e3e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:23.099731 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2199e06d-4f5f-4739-823f-665d6c398e3e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:23.100339 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2199e06d-4f5f-4739-823f-665d6c398e3e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:23.100846 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2199e06d-4f5f-4739-823f-665d6c398e3e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:23.133083 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-2199e06d-4f5f-4739-823f-665d6c398e3e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048505 Nov 02 14:44:23.133913 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 291/601] 10.222.0.30 () {58 vars in 1302 bytes} [Wed Nov 2 14:44:23 2022] GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 14:44:23.216008 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-fa70e754-d32e-41ae-8f9d-0eea08c30863 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:23.216559 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-fa70e754-d32e-41ae-8f9d-0eea08c30863 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:23.222869 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fa70e754-d32e-41ae-8f9d-0eea08c30863 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:23.223345 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fa70e754-d32e-41ae-8f9d-0eea08c30863 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:23.223775 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fa70e754-d32e-41ae-8f9d-0eea08c30863 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:23.224468 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fa70e754-d32e-41ae-8f9d-0eea08c30863 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:23.224914 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fa70e754-d32e-41ae-8f9d-0eea08c30863 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:23.225361 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fa70e754-d32e-41ae-8f9d-0eea08c30863 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:23.256367 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-fa70e754-d32e-41ae-8f9d-0eea08c30863 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91] Going to try to terminate instance {{(pid=119659) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:44:23.663908 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-fa70e754-d32e-41ae-8f9d-0eea08c30863 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91" status: 204 len: 0 microversion: 2.1 time: 0.450666 Nov 02 14:44:23.663908 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 311/602] 10.222.0.30 () {58 vars in 1239 bytes} [Wed Nov 2 14:44:23 2022] DELETE /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:44:23.674094 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-4ef8eb0a-34ad-4fd2-9275-740083107e06 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:23.674708 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-4ef8eb0a-34ad-4fd2-9275-740083107e06 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:23.683432 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4ef8eb0a-34ad-4fd2-9275-740083107e06 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:23.683962 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4ef8eb0a-34ad-4fd2-9275-740083107e06 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:23.684407 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4ef8eb0a-34ad-4fd2-9275-740083107e06 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:23.685156 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4ef8eb0a-34ad-4fd2-9275-740083107e06 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:23.685616 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4ef8eb0a-34ad-4fd2-9275-740083107e06 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:23.686043 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4ef8eb0a-34ad-4fd2-9275-740083107e06 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:23.956332 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-4ef8eb0a-34ad-4fd2-9275-740083107e06 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:23.965230 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-4ef8eb0a-34ad-4fd2-9275-740083107e06 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91" status: 200 len: 1690 microversion: 2.1 time: 0.296945 Nov 02 14:44:23.966139 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 292/603] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:44:23 2022] GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 => generated 1690 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:24.991453 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-14e7030b-0ba5-4975-9a7e-6302adf98a39 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:24.995658 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-14e7030b-0ba5-4975-9a7e-6302adf98a39 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:24.998730 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-14e7030b-0ba5-4975-9a7e-6302adf98a39 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:24.999704 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-14e7030b-0ba5-4975-9a7e-6302adf98a39 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:25.000133 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-14e7030b-0ba5-4975-9a7e-6302adf98a39 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:25.000935 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-14e7030b-0ba5-4975-9a7e-6302adf98a39 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:25.001405 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-14e7030b-0ba5-4975-9a7e-6302adf98a39 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:25.001823 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-14e7030b-0ba5-4975-9a7e-6302adf98a39 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:25.150084 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-14e7030b-0ba5-4975-9a7e-6302adf98a39 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:25.159311 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-14e7030b-0ba5-4975-9a7e-6302adf98a39 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91" status: 200 len: 1690 microversion: 2.1 time: 0.172072 Nov 02 14:44:25.159801 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 312/604] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:44:24 2022] GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 => generated 1690 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:26.182808 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-94a0360c-eff0-44db-9527-0618aa3a6b3e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:26.183432 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-94a0360c-eff0-44db-9527-0618aa3a6b3e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:26.191044 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-94a0360c-eff0-44db-9527-0618aa3a6b3e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:26.191609 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-94a0360c-eff0-44db-9527-0618aa3a6b3e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:26.191992 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-94a0360c-eff0-44db-9527-0618aa3a6b3e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:26.192707 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-94a0360c-eff0-44db-9527-0618aa3a6b3e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:26.193199 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-94a0360c-eff0-44db-9527-0618aa3a6b3e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:26.193631 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-94a0360c-eff0-44db-9527-0618aa3a6b3e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:26.327147 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-94a0360c-eff0-44db-9527-0618aa3a6b3e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:26.335870 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-94a0360c-eff0-44db-9527-0618aa3a6b3e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91" status: 200 len: 1690 microversion: 2.1 time: 0.156949 Nov 02 14:44:26.336614 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 293/605] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:44:26 2022] GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 => generated 1690 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:27.359984 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-91253f55-d89c-4122-a29a-5e3123f7f7b4 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:27.360594 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-91253f55-d89c-4122-a29a-5e3123f7f7b4 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:27.367879 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-91253f55-d89c-4122-a29a-5e3123f7f7b4 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:27.368697 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-91253f55-d89c-4122-a29a-5e3123f7f7b4 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:27.369194 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-91253f55-d89c-4122-a29a-5e3123f7f7b4 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:27.370174 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-91253f55-d89c-4122-a29a-5e3123f7f7b4 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:27.370917 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-91253f55-d89c-4122-a29a-5e3123f7f7b4 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:27.371344 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-91253f55-d89c-4122-a29a-5e3123f7f7b4 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:27.643054 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-91253f55-d89c-4122-a29a-5e3123f7f7b4 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:27.650706 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-91253f55-d89c-4122-a29a-5e3123f7f7b4 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91" status: 200 len: 1690 microversion: 2.1 time: 0.294846 Nov 02 14:44:27.651278 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 313/606] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:44:27 2022] GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 => generated 1690 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:28.155657 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [req-0aa594a7-11a4-40a5-8e56-9fdd638efff1 req-8f66290d-e475-428f-948d-691cd4185368 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d1d6b9a-4ef9-47db-b416-7a0a0f885d91", "name": "network-vif-deleted", "tag": "fc1bebad-c267-4384-b8ba-b3d4c19799bd"}]} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:44:28.181097 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-0aa594a7-11a4-40a5-8e56-9fdd638efff1 req-8f66290d-e475-428f-948d-691cd4185368 service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:28.183231 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-0aa594a7-11a4-40a5-8e56-9fdd638efff1 req-8f66290d-e475-428f-948d-691cd4185368 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:28.185078 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-0aa594a7-11a4-40a5-8e56-9fdd638efff1 req-8f66290d-e475-428f-948d-691cd4185368 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:28.248085 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.compute.server_external_events [req-0aa594a7-11a4-40a5-8e56-9fdd638efff1 req-8f66290d-e475-428f-948d-691cd4185368 service nova] Creating event network-vif-deleted:fc1bebad-c267-4384-b8ba-b3d4c19799bd for instance 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 on hv-cinder-86236 Nov 02 14:44:28.256976 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [req-0aa594a7-11a4-40a5-8e56-9fdd638efff1 req-8f66290d-e475-428f-948d-691cd4185368 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112806 Nov 02 14:44:28.260540 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 294/607] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:44:28.674408 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-eb5d738b-1434-43bd-aa33-ae113539657d tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:28.675015 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-eb5d738b-1434-43bd-aa33-ae113539657d tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:28.682478 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-eb5d738b-1434-43bd-aa33-ae113539657d tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:28.683625 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-eb5d738b-1434-43bd-aa33-ae113539657d tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:28.701184 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-eb5d738b-1434-43bd-aa33-ae113539657d tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:28.701184 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-eb5d738b-1434-43bd-aa33-ae113539657d tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:28.701184 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-eb5d738b-1434-43bd-aa33-ae113539657d tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:28.701184 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-eb5d738b-1434-43bd-aa33-ae113539657d tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:28.733654 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-eb5d738b-1434-43bd-aa33-ae113539657d tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:28.734473 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-eb5d738b-1434-43bd-aa33-ae113539657d tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:28.734707 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-eb5d738b-1434-43bd-aa33-ae113539657d tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:28.735215 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.objects.instance [None req-eb5d738b-1434-43bd-aa33-ae113539657d tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lazy-loading 'fault' on Instance uuid 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 {{(pid=119659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:44:28.779397 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-eb5d738b-1434-43bd-aa33-ae113539657d tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:28.789458 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-eb5d738b-1434-43bd-aa33-ae113539657d tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91" status: 200 len: 1335 microversion: 2.1 time: 0.118800 Nov 02 14:44:28.802195 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 314/608] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:44:28 2022] GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 => generated 1335 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:29.813130 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-7e22666d-b200-42b2-a545-240926d2354b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:29.813857 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-7e22666d-b200-42b2-a545-240926d2354b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:29.820404 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7e22666d-b200-42b2-a545-240926d2354b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:29.820931 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7e22666d-b200-42b2-a545-240926d2354b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:29.821410 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7e22666d-b200-42b2-a545-240926d2354b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:29.822121 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7e22666d-b200-42b2-a545-240926d2354b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:29.822557 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7e22666d-b200-42b2-a545-240926d2354b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:29.822978 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7e22666d-b200-42b2-a545-240926d2354b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:29.837023 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.wsgi [None req-7e22666d-b200-42b2-a545-240926d2354b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] HTTP exception thrown: Instance 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 could not be found. Nov 02 14:44:29.838727 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-7e22666d-b200-42b2-a545-240926d2354b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Request method failure captured: Nov 02 14:44:29.838727 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: request: GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 HTTP/1.1 Nov 02 14:44:29.838727 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Accept: application/json Nov 02 14:44:29.838727 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Accept-Encoding: identity Nov 02 14:44:29.838727 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Connection: close Nov 02 14:44:29.838727 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Content-Length: 0 Nov 02 14:44:29.838727 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Content-Type: application/json Nov 02 14:44:29.838727 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Host: 10.222.0.30 Nov 02 14:44:29.838727 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Openstack-System-Scope: None Nov 02 14:44:29.838727 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: User-Agent: python-urllib3/1.26.12 Nov 02 14:44:29.838727 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Auth-Token: gAAAAABjYoEkmtPFFndA3pI-hOMfV7WeoZBKhAJ-580_WIi7mvkfUXB_maVp8Mt8Up4K9l56kfyts_G8Q7rNjcSVvl07EMxmG19Ns5oBN2S0eWoNg7Mp3X9Xfyoe_HCMO3EwwbvsyRXXHW6uAL6g6f3-FqHT3Vo42Jex2zLZydCgw7GbTD2dulA Nov 02 14:44:29.838727 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Domain-Id: None Nov 02 14:44:29.838727 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Domain-Name: None Nov 02 14:44:29.838727 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Identity-Status: Confirmed Nov 02 14:44:29.838727 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Is-Admin-Project: True Nov 02 14:44:29.838727 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Domain-Id: default Nov 02 14:44:29.838727 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Domain-Name: Default Nov 02 14:44:29.838727 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Id: edc675d4a92f4ff9ae8a41a020fa792c Nov 02 14:44:29.838727 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-978907565 Nov 02 14:44:29.838727 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Role: reader,member Nov 02 14:44:29.838727 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Roles: reader,member Nov 02 14:44:29.840369 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/edc675d4a92f4ff9ae8a41a020fa792c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/edc675d4a92f4ff9ae8a41a020fa792c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/edc675d4a92f4ff9ae8a41a020fa792c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_edc675d4a92f4ff9ae8a41a020fa792c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:44:29.840369 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant: tempest-ServerRescueNegativeTestJSON-978907565 Nov 02 14:44:29.840369 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant-Id: edc675d4a92f4ff9ae8a41a020fa792c Nov 02 14:44:29.840369 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-978907565 Nov 02 14:44:29.840369 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User: tempest-ServerRescueNegativeTestJSON-978907565-project Nov 02 14:44:29.840369 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Domain-Id: default Nov 02 14:44:29.840369 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Domain-Name: Default Nov 02 14:44:29.840369 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Id: 921ba33e2e0740278b7b6fb4af248363 Nov 02 14:44:29.840369 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Name: tempest-ServerRescueNegativeTestJSON-978907565-project Nov 02 14:44:29.840369 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: method: > Nov 02 14:44:29.840369 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: exception: Instance 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 could not be found. Nov 02 14:44:29.840369 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: action_args: {'id': '4d1d6b9a-4ef9-47db-b416-7a0a0f885d91'} Nov 02 14:44:29.842143 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:44:29.842143 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:44:29.842143 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:44:29.842143 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:44:29.842143 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:44:29.842143 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:44:29.842143 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:44:29.842143 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:44:29.842143 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:44:29.842143 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:44:29.842143 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 could not be found. Nov 02 14:44:29.842143 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:44:29.842143 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:44:29.842143 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:44:29.842143 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:44:29.842143 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:44:29.842143 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:44:29.842143 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:44:29.842143 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:44:29.842143 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:44:29.844062 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:44:29.844062 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:44:29.844062 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:44:29.844062 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:44:29.844062 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:44:29.844062 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:44:29.844062 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:44:29.844062 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 could not be found. Nov 02 14:44:29.844062 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:44:29.844062 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:44:29.844062 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:44:29.844062 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:44:29.844062 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:44:29.844062 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:44:29.844062 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:44:29.844062 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:44:29.844062 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 could not be found. Nov 02 14:44:29.844062 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:44:29.845850 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-7e22666d-b200-42b2-a545-240926d2354b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Returning 404 to user: Instance 4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 could not be found. {{(pid=119658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:44:29.845850 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-7e22666d-b200-42b2-a545-240926d2354b tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91" status: 404 len: 111 microversion: 2.1 time: 0.031390 Nov 02 14:44:29.845850 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 295/609] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:44:29 2022] GET /compute/v2.1/servers/4d1d6b9a-4ef9-47db-b416-7a0a0f885d91 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:44:29.850456 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-2c9f0c2a-f62d-4a83-866f-89af84cda558 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '.version_select at 0x7fb24ef41af0>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:29.956082 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-2c9f0c2a-f62d-4a83-866f-89af84cda558 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-872299571" status: 202 len: 0 microversion: 2.1 time: 0.109402 Nov 02 14:44:29.956691 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 315/610] 10.222.0.30 () {58 vars in 1218 bytes} [Wed Nov 2 14:44:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-872299571 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:44:33.468748 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-c00ee0a2-c16b-4794-b301-a98b1f1c013e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:33.470061 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-c00ee0a2-c16b-4794-b301-a98b1f1c013e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:33.472951 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:44:33.478232 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c00ee0a2-c16b-4794-b301-a98b1f1c013e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:33.478827 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c00ee0a2-c16b-4794-b301-a98b1f1c013e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:33.479341 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c00ee0a2-c16b-4794-b301-a98b1f1c013e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:33.480365 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c00ee0a2-c16b-4794-b301-a98b1f1c013e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:33.480955 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c00ee0a2-c16b-4794-b301-a98b1f1c013e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:33.481481 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c00ee0a2-c16b-4794-b301-a98b1f1c013e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:33.510998 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-c00ee0a2-c16b-4794-b301-a98b1f1c013e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Going to try to terminate instance {{(pid=119658) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:44:33.878831 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-c00ee0a2-c16b-4794-b301-a98b1f1c013e tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 204 len: 0 microversion: 2.1 time: 0.414281 Nov 02 14:44:33.879426 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 296/611] 10.222.0.30 () {58 vars in 1239 bytes} [Wed Nov 2 14:44:33 2022] DELETE /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:44:33.888760 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-d6276240-992c-4843-9839-47d7d006442d tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:33.889524 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-d6276240-992c-4843-9839-47d7d006442d tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:33.892260 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:44:33.897380 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d6276240-992c-4843-9839-47d7d006442d tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:33.897950 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d6276240-992c-4843-9839-47d7d006442d tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:33.898477 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d6276240-992c-4843-9839-47d7d006442d tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:33.899247 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d6276240-992c-4843-9839-47d7d006442d tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:33.899761 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d6276240-992c-4843-9839-47d7d006442d tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:33.900400 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d6276240-992c-4843-9839-47d7d006442d tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:34.127584 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-d6276240-992c-4843-9839-47d7d006442d tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:34.136004 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-d6276240-992c-4843-9839-47d7d006442d tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1509 microversion: 2.1 time: 0.252286 Nov 02 14:44:34.136589 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 316/612] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:44:33 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1509 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:35.164728 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-4d0fc6eb-ab03-484a-91b3-893c320d867c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:35.166539 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-4d0fc6eb-ab03-484a-91b3-893c320d867c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:35.177609 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4d0fc6eb-ab03-484a-91b3-893c320d867c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:35.178709 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4d0fc6eb-ab03-484a-91b3-893c320d867c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:35.179379 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4d0fc6eb-ab03-484a-91b3-893c320d867c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:35.180697 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4d0fc6eb-ab03-484a-91b3-893c320d867c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:35.181423 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4d0fc6eb-ab03-484a-91b3-893c320d867c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:35.182073 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4d0fc6eb-ab03-484a-91b3-893c320d867c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:35.340690 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-4d0fc6eb-ab03-484a-91b3-893c320d867c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:35.349554 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-4d0fc6eb-ab03-484a-91b3-893c320d867c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1509 microversion: 2.1 time: 0.192368 Nov 02 14:44:35.360075 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 297/613] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:44:35 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1509 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:36.371695 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 14:44:36.376255 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Wed Nov 2 14:44:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 (ip 10.222.0.30) !!! Nov 02 14:44:36.378044 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-4a0e75bb-8473-4f3f-b89e-a89b6e3ec8a7 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:36.378892 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-4a0e75bb-8473-4f3f-b89e-a89b6e3ec8a7 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:36.386394 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4a0e75bb-8473-4f3f-b89e-a89b6e3ec8a7 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:36.386997 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4a0e75bb-8473-4f3f-b89e-a89b6e3ec8a7 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:36.387670 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4a0e75bb-8473-4f3f-b89e-a89b6e3ec8a7 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:36.388584 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4a0e75bb-8473-4f3f-b89e-a89b6e3ec8a7 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:36.389166 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4a0e75bb-8473-4f3f-b89e-a89b6e3ec8a7 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:36.390333 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4a0e75bb-8473-4f3f-b89e-a89b6e3ec8a7 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:36.610073 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-4a0e75bb-8473-4f3f-b89e-a89b6e3ec8a7 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:36.618493 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-4a0e75bb-8473-4f3f-b89e-a89b6e3ec8a7 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1509 microversion: 2.1 time: 0.248893 Nov 02 14:44:36.619811 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 317/614] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:44:36 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1509 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:44:36.912098 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [req-a9a58195-745a-49ba-8a25-73894312b47e req-38b5dc11-dda6-4848-98a1-3ca0c6ff73ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1620aab-e26a-482d-9816-6fa784243fc9", "name": "network-vif-deleted", "tag": "c0906b93-2520-43fe-8940-decdff05858b"}]} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:44:36.924507 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-a9a58195-745a-49ba-8a25-73894312b47e req-38b5dc11-dda6-4848-98a1-3ca0c6ff73ea service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:36.924855 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-a9a58195-745a-49ba-8a25-73894312b47e req-38b5dc11-dda6-4848-98a1-3ca0c6ff73ea service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:36.925033 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-a9a58195-745a-49ba-8a25-73894312b47e req-38b5dc11-dda6-4848-98a1-3ca0c6ff73ea service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:36.941385 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.compute.server_external_events [req-a9a58195-745a-49ba-8a25-73894312b47e req-38b5dc11-dda6-4848-98a1-3ca0c6ff73ea service nova] Creating event network-vif-deleted:c0906b93-2520-43fe-8940-decdff05858b for instance d1620aab-e26a-482d-9816-6fa784243fc9 on hv-cinder-86236 Nov 02 14:44:36.948464 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [req-a9a58195-745a-49ba-8a25-73894312b47e req-38b5dc11-dda6-4848-98a1-3ca0c6ff73ea service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061945 Nov 02 14:44:36.952727 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 298/615] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:44:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:44:37.653882 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-c4528009-0486-42d4-a58b-b43a4d3e9edc tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:37.654504 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-c4528009-0486-42d4-a58b-b43a4d3e9edc tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:37.661575 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c4528009-0486-42d4-a58b-b43a4d3e9edc tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:37.662061 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c4528009-0486-42d4-a58b-b43a4d3e9edc tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:37.662706 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c4528009-0486-42d4-a58b-b43a4d3e9edc tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:37.663399 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c4528009-0486-42d4-a58b-b43a4d3e9edc tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:37.663849 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c4528009-0486-42d4-a58b-b43a4d3e9edc tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:37.664563 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c4528009-0486-42d4-a58b-b43a4d3e9edc tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:37.698639 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c4528009-0486-42d4-a58b-b43a4d3e9edc tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:37.699125 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c4528009-0486-42d4-a58b-b43a4d3e9edc tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:37.699789 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c4528009-0486-42d4-a58b-b43a4d3e9edc tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:37.700234 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.objects.instance [None req-c4528009-0486-42d4-a58b-b43a4d3e9edc tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lazy-loading 'fault' on Instance uuid d1620aab-e26a-482d-9816-6fa784243fc9 {{(pid=119659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:44:37.742022 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-c4528009-0486-42d4-a58b-b43a4d3e9edc tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:37.752120 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-c4528009-0486-42d4-a58b-b43a4d3e9edc tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 200 len: 1312 microversion: 2.1 time: 0.103641 Nov 02 14:44:37.765807 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 318/616] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:44:37 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 1312 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:44:38.777944 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-cfc6d579-8f4e-414e-b8a4-29dadfffc2f7 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:38.778651 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-cfc6d579-8f4e-414e-b8a4-29dadfffc2f7 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: d1620aab-e26a-482d-9816-6fa784243fc9] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:38.786654 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-cfc6d579-8f4e-414e-b8a4-29dadfffc2f7 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:38.787152 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-cfc6d579-8f4e-414e-b8a4-29dadfffc2f7 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:38.787594 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-cfc6d579-8f4e-414e-b8a4-29dadfffc2f7 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:38.788301 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-cfc6d579-8f4e-414e-b8a4-29dadfffc2f7 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:38.788760 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-cfc6d579-8f4e-414e-b8a4-29dadfffc2f7 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:38.789219 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-cfc6d579-8f4e-414e-b8a4-29dadfffc2f7 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:38.803466 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.wsgi [None req-cfc6d579-8f4e-414e-b8a4-29dadfffc2f7 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] HTTP exception thrown: Instance d1620aab-e26a-482d-9816-6fa784243fc9 could not be found. Nov 02 14:44:38.805149 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-cfc6d579-8f4e-414e-b8a4-29dadfffc2f7 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Request method failure captured: Nov 02 14:44:38.805149 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: request: GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 HTTP/1.1 Nov 02 14:44:38.805149 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Accept: application/json Nov 02 14:44:38.805149 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Accept-Encoding: identity Nov 02 14:44:38.805149 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Connection: close Nov 02 14:44:38.805149 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Content-Length: 0 Nov 02 14:44:38.805149 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Content-Type: application/json Nov 02 14:44:38.805149 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Host: 10.222.0.30 Nov 02 14:44:38.805149 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Openstack-System-Scope: None Nov 02 14:44:38.805149 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: User-Agent: python-urllib3/1.26.12 Nov 02 14:44:38.805149 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Auth-Token: gAAAAABjYoEkmtPFFndA3pI-hOMfV7WeoZBKhAJ-580_WIi7mvkfUXB_maVp8Mt8Up4K9l56kfyts_G8Q7rNjcSVvl07EMxmG19Ns5oBN2S0eWoNg7Mp3X9Xfyoe_HCMO3EwwbvsyRXXHW6uAL6g6f3-FqHT3Vo42Jex2zLZydCgw7GbTD2dulA Nov 02 14:44:38.805149 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Domain-Id: None Nov 02 14:44:38.805149 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Domain-Name: None Nov 02 14:44:38.805149 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Identity-Status: Confirmed Nov 02 14:44:38.805149 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Is-Admin-Project: True Nov 02 14:44:38.805149 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Domain-Id: default Nov 02 14:44:38.805149 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Domain-Name: Default Nov 02 14:44:38.805149 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Id: edc675d4a92f4ff9ae8a41a020fa792c Nov 02 14:44:38.805149 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-978907565 Nov 02 14:44:38.805149 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Role: reader,member Nov 02 14:44:38.805149 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Roles: reader,member Nov 02 14:44:38.810822 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/edc675d4a92f4ff9ae8a41a020fa792c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/edc675d4a92f4ff9ae8a41a020fa792c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/edc675d4a92f4ff9ae8a41a020fa792c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_edc675d4a92f4ff9ae8a41a020fa792c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:44:38.810822 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant: tempest-ServerRescueNegativeTestJSON-978907565 Nov 02 14:44:38.810822 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant-Id: edc675d4a92f4ff9ae8a41a020fa792c Nov 02 14:44:38.810822 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-978907565 Nov 02 14:44:38.810822 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User: tempest-ServerRescueNegativeTestJSON-978907565-project Nov 02 14:44:38.810822 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Domain-Id: default Nov 02 14:44:38.810822 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Domain-Name: Default Nov 02 14:44:38.810822 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Id: 921ba33e2e0740278b7b6fb4af248363 Nov 02 14:44:38.810822 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Name: tempest-ServerRescueNegativeTestJSON-978907565-project Nov 02 14:44:38.810822 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: method: > Nov 02 14:44:38.810822 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: exception: Instance d1620aab-e26a-482d-9816-6fa784243fc9 could not be found. Nov 02 14:44:38.810822 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: action_args: {'id': 'd1620aab-e26a-482d-9816-6fa784243fc9'} Nov 02 14:44:38.811793 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:44:38.811793 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:44:38.811793 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:44:38.811793 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:44:38.811793 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:44:38.811793 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:44:38.811793 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:44:38.811793 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:44:38.811793 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:44:38.811793 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:44:38.811793 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1620aab-e26a-482d-9816-6fa784243fc9 could not be found. Nov 02 14:44:38.811793 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:44:38.811793 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:44:38.811793 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:44:38.811793 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:44:38.811793 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:44:38.811793 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:44:38.811793 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:44:38.811793 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:44:38.811793 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:44:38.813067 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:44:38.813067 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:44:38.813067 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:44:38.813067 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:44:38.813067 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:44:38.813067 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:44:38.813067 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:44:38.813067 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1620aab-e26a-482d-9816-6fa784243fc9 could not be found. Nov 02 14:44:38.813067 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:44:38.813067 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:44:38.813067 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:44:38.813067 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:44:38.813067 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:44:38.813067 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:44:38.813067 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:44:38.813067 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:44:38.813067 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1620aab-e26a-482d-9816-6fa784243fc9 could not be found. Nov 02 14:44:38.813067 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:44:38.814177 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-cfc6d579-8f4e-414e-b8a4-29dadfffc2f7 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Returning 404 to user: Instance d1620aab-e26a-482d-9816-6fa784243fc9 could not be found. {{(pid=119658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:44:38.814177 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-cfc6d579-8f4e-414e-b8a4-29dadfffc2f7 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9" status: 404 len: 111 microversion: 2.1 time: 0.033006 Nov 02 14:44:38.814177 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 299/617] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:44:38 2022] GET /compute/v2.1/servers/d1620aab-e26a-482d-9816-6fa784243fc9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:44:38.817669 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-074df642-721f-4bf6-8ac4-9bfbd9020eed tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:38.818632 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-074df642-721f-4bf6-8ac4-9bfbd9020eed tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 803e6b19-d962-4158-9a6c-e38cbd2b3e04] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:38.826663 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-074df642-721f-4bf6-8ac4-9bfbd9020eed tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:38.827720 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-074df642-721f-4bf6-8ac4-9bfbd9020eed tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:38.828164 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-074df642-721f-4bf6-8ac4-9bfbd9020eed tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:38.828896 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-074df642-721f-4bf6-8ac4-9bfbd9020eed tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:38.829724 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-074df642-721f-4bf6-8ac4-9bfbd9020eed tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:38.830347 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-074df642-721f-4bf6-8ac4-9bfbd9020eed tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:38.860149 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-074df642-721f-4bf6-8ac4-9bfbd9020eed tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 803e6b19-d962-4158-9a6c-e38cbd2b3e04] Going to try to terminate instance {{(pid=119659) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:44:38.990846 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:44:39.203649 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-074df642-721f-4bf6-8ac4-9bfbd9020eed tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "DELETE /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04" status: 204 len: 0 microversion: 2.1 time: 0.389999 Nov 02 14:44:39.204550 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 319/618] 10.222.0.30 () {58 vars in 1239 bytes} [Wed Nov 2 14:44:38 2022] DELETE /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:44:39.213198 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-fb21bc9c-86ee-454f-8209-8c7f217dfdf6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:39.214079 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-fb21bc9c-86ee-454f-8209-8c7f217dfdf6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 803e6b19-d962-4158-9a6c-e38cbd2b3e04] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:39.221666 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-fb21bc9c-86ee-454f-8209-8c7f217dfdf6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:39.222243 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-fb21bc9c-86ee-454f-8209-8c7f217dfdf6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:39.222743 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-fb21bc9c-86ee-454f-8209-8c7f217dfdf6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:39.223617 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-fb21bc9c-86ee-454f-8209-8c7f217dfdf6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:39.224133 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-fb21bc9c-86ee-454f-8209-8c7f217dfdf6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:39.224636 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-fb21bc9c-86ee-454f-8209-8c7f217dfdf6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:39.408270 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-fb21bc9c-86ee-454f-8209-8c7f217dfdf6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:39.416988 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-fb21bc9c-86ee-454f-8209-8c7f217dfdf6 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04" status: 200 len: 1523 microversion: 2.1 time: 0.207771 Nov 02 14:44:39.417565 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 300/619] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:44:39 2022] GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04 => generated 1523 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:40.441530 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-8f28ec8a-8d08-4e3b-96c0-5c7818cb777d tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:40.442492 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-8f28ec8a-8d08-4e3b-96c0-5c7818cb777d tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 803e6b19-d962-4158-9a6c-e38cbd2b3e04] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:40.453082 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8f28ec8a-8d08-4e3b-96c0-5c7818cb777d tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:40.453862 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8f28ec8a-8d08-4e3b-96c0-5c7818cb777d tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:40.454301 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8f28ec8a-8d08-4e3b-96c0-5c7818cb777d tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:40.455013 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8f28ec8a-8d08-4e3b-96c0-5c7818cb777d tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:40.455456 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8f28ec8a-8d08-4e3b-96c0-5c7818cb777d tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:40.455874 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8f28ec8a-8d08-4e3b-96c0-5c7818cb777d tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:40.620767 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-8f28ec8a-8d08-4e3b-96c0-5c7818cb777d tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:40.645550 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-8f28ec8a-8d08-4e3b-96c0-5c7818cb777d tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04" status: 200 len: 1523 microversion: 2.1 time: 0.193949 Nov 02 14:44:40.645550 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 320/620] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:44:40 2022] GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04 => generated 1523 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:41.657096 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-46675315-5404-446f-a659-0bdd5e490f0c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:41.657862 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-46675315-5404-446f-a659-0bdd5e490f0c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 803e6b19-d962-4158-9a6c-e38cbd2b3e04] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:41.672757 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-46675315-5404-446f-a659-0bdd5e490f0c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:41.675752 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-46675315-5404-446f-a659-0bdd5e490f0c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:41.676631 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-46675315-5404-446f-a659-0bdd5e490f0c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:41.677416 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-46675315-5404-446f-a659-0bdd5e490f0c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:41.677880 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-46675315-5404-446f-a659-0bdd5e490f0c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:41.683177 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-46675315-5404-446f-a659-0bdd5e490f0c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:41.909118 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-46675315-5404-446f-a659-0bdd5e490f0c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:41.925215 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-46675315-5404-446f-a659-0bdd5e490f0c tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04" status: 200 len: 1523 microversion: 2.1 time: 0.267227 Nov 02 14:44:41.925215 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 301/621] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:44:41 2022] GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04 => generated 1523 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:42.943942 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-e9a80533-8b45-44f0-8901-f3638c6ee352 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:42.944569 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-e9a80533-8b45-44f0-8901-f3638c6ee352 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 803e6b19-d962-4158-9a6c-e38cbd2b3e04] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:42.957602 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e9a80533-8b45-44f0-8901-f3638c6ee352 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:42.958821 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e9a80533-8b45-44f0-8901-f3638c6ee352 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:42.959628 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e9a80533-8b45-44f0-8901-f3638c6ee352 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:42.962759 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e9a80533-8b45-44f0-8901-f3638c6ee352 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:42.963428 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e9a80533-8b45-44f0-8901-f3638c6ee352 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:42.964827 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e9a80533-8b45-44f0-8901-f3638c6ee352 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:43.166058 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-e9a80533-8b45-44f0-8901-f3638c6ee352 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:43.176707 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-e9a80533-8b45-44f0-8901-f3638c6ee352 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04" status: 200 len: 1481 microversion: 2.1 time: 0.237723 Nov 02 14:44:43.178186 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 321/622] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:44:42 2022] GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04 => generated 1481 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:43.193243 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [req-d8fe6930-cfe7-4a83-8ffb-fb50070d5b93 req-6a7bf11b-8c20-4171-844a-debec7f0cd6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "803e6b19-d962-4158-9a6c-e38cbd2b3e04", "name": "network-vif-deleted", "tag": "b3d49dc7-6e55-4eda-a524-acbf2248d0e8"}]} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:44:43.213784 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-d8fe6930-cfe7-4a83-8ffb-fb50070d5b93 req-6a7bf11b-8c20-4171-844a-debec7f0cd6a service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:43.214715 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-d8fe6930-cfe7-4a83-8ffb-fb50070d5b93 req-6a7bf11b-8c20-4171-844a-debec7f0cd6a service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:43.217647 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-d8fe6930-cfe7-4a83-8ffb-fb50070d5b93 req-6a7bf11b-8c20-4171-844a-debec7f0cd6a service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:43.243721 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.compute.server_external_events [req-d8fe6930-cfe7-4a83-8ffb-fb50070d5b93 req-6a7bf11b-8c20-4171-844a-debec7f0cd6a service nova] Creating event network-vif-deleted:b3d49dc7-6e55-4eda-a524-acbf2248d0e8 for instance 803e6b19-d962-4158-9a6c-e38cbd2b3e04 on hv-cinder-86236 Nov 02 14:44:43.255452 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [req-d8fe6930-cfe7-4a83-8ffb-fb50070d5b93 req-6a7bf11b-8c20-4171-844a-debec7f0cd6a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076796 Nov 02 14:44:43.257186 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 322/623] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:44:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:44:43.498883 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-616747c5-3ca5-4de7-b704-628472366370 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:43.500834 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-616747c5-3ca5-4de7-b704-628472366370 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:43.510741 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-616747c5-3ca5-4de7-b704-628472366370 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:43.511614 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-616747c5-3ca5-4de7-b704-628472366370 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:43.512252 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-616747c5-3ca5-4de7-b704-628472366370 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:43.513418 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-616747c5-3ca5-4de7-b704-628472366370 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:43.514672 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-616747c5-3ca5-4de7-b704-628472366370 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:43.515385 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-616747c5-3ca5-4de7-b704-628472366370 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:43.547980 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-616747c5-3ca5-4de7-b704-628472366370 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0/ips" status: 200 len: 152 microversion: 2.20 time: 0.513408 Nov 02 14:44:43.548868 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 302/624] 10.222.0.30 () {60 vars in 1289 bytes} [Wed Nov 2 14:44:43 2022] GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0/ips => generated 152 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 14:44:43.550356 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-5f92c864-88e9-4dc6-a608-af1364e01720 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Action: 'create', calling method: .version_select at 0x7fb24ef8dca0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-667872314", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEzkLiimx61FaBghcXGQXJHSkm90r3/ssCaxFyHFHLsyza+/Cd7iqF9WsUHTM54EJRgKCHD6WQN0FDZzqtOS5tYNibj44vWd79xUsY9mTvfT4RBB9/06BThFp3FeaxG9Pg=="}} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:44:43.578683 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.quota [None req-5f92c864-88e9-4dc6-a608-af1364e01720 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Getting quotas for project 990b7e753ad1450489668d0ca151736e. Resources: {'key_pairs'} {{(pid=119659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:44:43.585422 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.quota [None req-5f92c864-88e9-4dc6-a608-af1364e01720 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Getting quotas for user 6f0516ac4c6648f9b208a89e174da3a3 and project 990b7e753ad1450489668d0ca151736e. Resources: {'key_pairs'} {{(pid=119659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:44:43.683033 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-5f92c864-88e9-4dc6-a608-af1364e01720 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.310769 Nov 02 14:44:43.684030 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 323/625] 10.222.0.30 () {60 vars in 1159 bytes} [Wed Nov 2 14:44:43 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:44:44.202466 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-838e2151-6723-4ca8-8452-e7ebcbf81fd8 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:44.203925 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-838e2151-6723-4ca8-8452-e7ebcbf81fd8 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 803e6b19-d962-4158-9a6c-e38cbd2b3e04] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:44.210356 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-838e2151-6723-4ca8-8452-e7ebcbf81fd8 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:44.210837 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-838e2151-6723-4ca8-8452-e7ebcbf81fd8 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:44.211279 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-838e2151-6723-4ca8-8452-e7ebcbf81fd8 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:44.211994 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-838e2151-6723-4ca8-8452-e7ebcbf81fd8 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:44.212558 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-838e2151-6723-4ca8-8452-e7ebcbf81fd8 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:44.212885 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-838e2151-6723-4ca8-8452-e7ebcbf81fd8 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:44.273009 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-838e2151-6723-4ca8-8452-e7ebcbf81fd8 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:44.273530 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-838e2151-6723-4ca8-8452-e7ebcbf81fd8 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:44.273972 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-838e2151-6723-4ca8-8452-e7ebcbf81fd8 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:44.274447 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.objects.instance [None req-838e2151-6723-4ca8-8452-e7ebcbf81fd8 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lazy-loading 'fault' on Instance uuid 803e6b19-d962-4158-9a6c-e38cbd2b3e04 {{(pid=119658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:44:44.318949 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-838e2151-6723-4ca8-8452-e7ebcbf81fd8 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921ba33e2e0740278b7b6fb4af248363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc675d4a92f4ff9ae8a41a020fa792c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:44.337369 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-838e2151-6723-4ca8-8452-e7ebcbf81fd8 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04" status: 200 len: 1312 microversion: 2.1 time: 0.138655 Nov 02 14:44:44.338314 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 303/626] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:44:44 2022] GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04 => generated 1312 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:45.362018 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-299917f8-2a71-4cdd-b348-79bf30099b88 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:45.362754 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-299917f8-2a71-4cdd-b348-79bf30099b88 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] [instance: 803e6b19-d962-4158-9a6c-e38cbd2b3e04] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:45.374707 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-299917f8-2a71-4cdd-b348-79bf30099b88 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:45.375682 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-299917f8-2a71-4cdd-b348-79bf30099b88 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:45.376907 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-299917f8-2a71-4cdd-b348-79bf30099b88 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:45.377300 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-299917f8-2a71-4cdd-b348-79bf30099b88 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:45.377887 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-299917f8-2a71-4cdd-b348-79bf30099b88 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:45.378318 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-299917f8-2a71-4cdd-b348-79bf30099b88 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:45.393798 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.wsgi [None req-299917f8-2a71-4cdd-b348-79bf30099b88 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] HTTP exception thrown: Instance 803e6b19-d962-4158-9a6c-e38cbd2b3e04 could not be found. Nov 02 14:44:45.395466 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-299917f8-2a71-4cdd-b348-79bf30099b88 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Request method failure captured: Nov 02 14:44:45.395466 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: request: GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04 HTTP/1.1 Nov 02 14:44:45.395466 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Accept: application/json Nov 02 14:44:45.395466 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Accept-Encoding: identity Nov 02 14:44:45.395466 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Connection: close Nov 02 14:44:45.395466 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Content-Length: 0 Nov 02 14:44:45.395466 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Content-Type: application/json Nov 02 14:44:45.395466 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Host: 10.222.0.30 Nov 02 14:44:45.395466 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Openstack-System-Scope: None Nov 02 14:44:45.395466 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: User-Agent: python-urllib3/1.26.12 Nov 02 14:44:45.395466 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Auth-Token: gAAAAABjYoEkmtPFFndA3pI-hOMfV7WeoZBKhAJ-580_WIi7mvkfUXB_maVp8Mt8Up4K9l56kfyts_G8Q7rNjcSVvl07EMxmG19Ns5oBN2S0eWoNg7Mp3X9Xfyoe_HCMO3EwwbvsyRXXHW6uAL6g6f3-FqHT3Vo42Jex2zLZydCgw7GbTD2dulA Nov 02 14:44:45.395466 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Domain-Id: None Nov 02 14:44:45.395466 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Domain-Name: None Nov 02 14:44:45.395466 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Identity-Status: Confirmed Nov 02 14:44:45.395466 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Is-Admin-Project: True Nov 02 14:44:45.395466 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Domain-Id: default Nov 02 14:44:45.395466 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Domain-Name: Default Nov 02 14:44:45.395466 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Id: edc675d4a92f4ff9ae8a41a020fa792c Nov 02 14:44:45.395466 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-978907565 Nov 02 14:44:45.395466 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Role: reader,member Nov 02 14:44:45.395466 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Roles: reader,member Nov 02 14:44:45.396896 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/edc675d4a92f4ff9ae8a41a020fa792c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/edc675d4a92f4ff9ae8a41a020fa792c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/edc675d4a92f4ff9ae8a41a020fa792c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_edc675d4a92f4ff9ae8a41a020fa792c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:44:45.396896 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant: tempest-ServerRescueNegativeTestJSON-978907565 Nov 02 14:44:45.396896 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant-Id: edc675d4a92f4ff9ae8a41a020fa792c Nov 02 14:44:45.396896 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-978907565 Nov 02 14:44:45.396896 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User: tempest-ServerRescueNegativeTestJSON-978907565-project Nov 02 14:44:45.396896 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Domain-Id: default Nov 02 14:44:45.396896 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Domain-Name: Default Nov 02 14:44:45.396896 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Id: 921ba33e2e0740278b7b6fb4af248363 Nov 02 14:44:45.396896 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Name: tempest-ServerRescueNegativeTestJSON-978907565-project Nov 02 14:44:45.396896 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: method: > Nov 02 14:44:45.396896 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: exception: Instance 803e6b19-d962-4158-9a6c-e38cbd2b3e04 could not be found. Nov 02 14:44:45.396896 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: action_args: {'id': '803e6b19-d962-4158-9a6c-e38cbd2b3e04'} Nov 02 14:44:45.397719 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:44:45.397719 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:44:45.397719 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:44:45.397719 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:44:45.397719 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:44:45.397719 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:44:45.397719 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:44:45.397719 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:44:45.397719 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:44:45.397719 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:44:45.397719 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 803e6b19-d962-4158-9a6c-e38cbd2b3e04 could not be found. Nov 02 14:44:45.397719 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:44:45.397719 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:44:45.397719 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:44:45.397719 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:44:45.397719 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:44:45.397719 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:44:45.397719 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:44:45.397719 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:44:45.397719 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:44:45.399140 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:44:45.399140 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:44:45.399140 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:44:45.399140 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:44:45.399140 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:44:45.399140 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:44:45.399140 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:44:45.399140 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 803e6b19-d962-4158-9a6c-e38cbd2b3e04 could not be found. Nov 02 14:44:45.399140 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:44:45.399140 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:44:45.399140 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:44:45.399140 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:44:45.399140 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:44:45.399140 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:44:45.399140 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:44:45.399140 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:44:45.399140 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 803e6b19-d962-4158-9a6c-e38cbd2b3e04 could not be found. Nov 02 14:44:45.399140 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:44:45.401320 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-299917f8-2a71-4cdd-b348-79bf30099b88 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] Returning 404 to user: Instance 803e6b19-d962-4158-9a6c-e38cbd2b3e04 could not be found. {{(pid=119659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:44:45.402194 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-299917f8-2a71-4cdd-b348-79bf30099b88 tempest-ServerRescueNegativeTestJSON-978907565 tempest-ServerRescueNegativeTestJSON-978907565-project] 10.222.0.30 "GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04" status: 404 len: 111 microversion: 2.1 time: 0.044768 Nov 02 14:44:45.402742 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 324/627] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:44:45 2022] GET /compute/v2.1/servers/803e6b19-d962-4158-9a6c-e38cbd2b3e04 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 14:44:46.231246 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-11a44ad2-4c83-4195-9ab9-acf2f97bd182 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:44:46.232390 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-11a44ad2-4c83-4195-9ab9-acf2f97bd182 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:46.240435 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-11a44ad2-4c83-4195-9ab9-acf2f97bd182 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:46.240934 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-11a44ad2-4c83-4195-9ab9-acf2f97bd182 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:46.241644 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-11a44ad2-4c83-4195-9ab9-acf2f97bd182 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:46.242607 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-11a44ad2-4c83-4195-9ab9-acf2f97bd182 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:46.243313 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-11a44ad2-4c83-4195-9ab9-acf2f97bd182 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:46.243813 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-11a44ad2-4c83-4195-9ab9-acf2f97bd182 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:46.246779 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:44:46.271324 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.objects.instance [None req-11a44ad2-4c83-4195-9ab9-acf2f97bd182 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lazy-loading 'flavor' on Instance uuid ea6a4066-de22-411b-9e4b-1531cb199bc0 {{(pid=119658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:44:46.883026 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-11a44ad2-4c83-4195-9ab9-acf2f97bd182 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "POST /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0/action" status: 202 len: 0 microversion: 2.20 time: 0.655727 Nov 02 14:44:46.884034 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 304/628] 10.222.0.30 () {62 vars in 1319 bytes} [Wed Nov 2 14:44:46 2022] POST /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0/action => generated 0 bytes in 658 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:44:46.897663 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-ceb03ef3-e475-4a0f-861d-124e1e69ded9 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:46.899695 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-ceb03ef3-e475-4a0f-861d-124e1e69ded9 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:46.917425 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ceb03ef3-e475-4a0f-861d-124e1e69ded9 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:46.918111 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ceb03ef3-e475-4a0f-861d-124e1e69ded9 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:46.918625 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ceb03ef3-e475-4a0f-861d-124e1e69ded9 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:46.919408 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ceb03ef3-e475-4a0f-861d-124e1e69ded9 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:46.919855 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ceb03ef3-e475-4a0f-861d-124e1e69ded9 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:46.920276 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ceb03ef3-e475-4a0f-861d-124e1e69ded9 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:47.099084 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-ceb03ef3-e475-4a0f-861d-124e1e69ded9 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:47.108686 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-ceb03ef3-e475-4a0f-861d-124e1e69ded9 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:47.114244 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-ceb03ef3-e475-4a0f-861d-124e1e69ded9 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:47.114244 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-ceb03ef3-e475-4a0f-861d-124e1e69ded9 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0" status: 200 len: 1722 microversion: 2.20 time: 0.223505 Nov 02 14:44:47.114244 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 325/629] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:44:46 2022] GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 => generated 1722 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:44:48.144563 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-08621804-3128-4479-8ab0-760090626a7b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:48.146146 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-08621804-3128-4479-8ab0-760090626a7b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:48.155614 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-08621804-3128-4479-8ab0-760090626a7b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:48.158027 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-08621804-3128-4479-8ab0-760090626a7b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:48.158580 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-08621804-3128-4479-8ab0-760090626a7b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:48.159840 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-08621804-3128-4479-8ab0-760090626a7b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:48.160374 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-08621804-3128-4479-8ab0-760090626a7b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:48.160861 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-08621804-3128-4479-8ab0-760090626a7b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:48.333842 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-08621804-3128-4479-8ab0-760090626a7b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:48.345503 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-08621804-3128-4479-8ab0-760090626a7b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:48.346947 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-08621804-3128-4479-8ab0-760090626a7b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:48.348107 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-08621804-3128-4479-8ab0-760090626a7b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0" status: 200 len: 1722 microversion: 2.20 time: 0.213791 Nov 02 14:44:48.348669 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 305/630] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:44:48 2022] GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 => generated 1722 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:44:49.376769 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-607ed6a2-e0aa-46d8-9ec2-debdce3cd324 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:49.378153 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-607ed6a2-e0aa-46d8-9ec2-debdce3cd324 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:49.394007 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-607ed6a2-e0aa-46d8-9ec2-debdce3cd324 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:49.398022 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-607ed6a2-e0aa-46d8-9ec2-debdce3cd324 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:49.398585 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-607ed6a2-e0aa-46d8-9ec2-debdce3cd324 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:49.399468 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-607ed6a2-e0aa-46d8-9ec2-debdce3cd324 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:49.400034 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-607ed6a2-e0aa-46d8-9ec2-debdce3cd324 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:49.400565 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-607ed6a2-e0aa-46d8-9ec2-debdce3cd324 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:49.601764 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-607ed6a2-e0aa-46d8-9ec2-debdce3cd324 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:49.611070 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-607ed6a2-e0aa-46d8-9ec2-debdce3cd324 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:49.612942 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-607ed6a2-e0aa-46d8-9ec2-debdce3cd324 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:49.614384 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-607ed6a2-e0aa-46d8-9ec2-debdce3cd324 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0" status: 200 len: 1722 microversion: 2.20 time: 0.242502 Nov 02 14:44:49.615477 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 326/631] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:44:49 2022] GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 => generated 1722 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:44:50.646710 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-cdfe9a87-5243-4e68-9b14-a3cd723aa3c8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:50.647343 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-cdfe9a87-5243-4e68-9b14-a3cd723aa3c8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:50.667341 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-cdfe9a87-5243-4e68-9b14-a3cd723aa3c8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:50.668044 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-cdfe9a87-5243-4e68-9b14-a3cd723aa3c8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:50.668426 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-cdfe9a87-5243-4e68-9b14-a3cd723aa3c8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:50.669241 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-cdfe9a87-5243-4e68-9b14-a3cd723aa3c8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:50.669616 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-cdfe9a87-5243-4e68-9b14-a3cd723aa3c8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:50.680210 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-cdfe9a87-5243-4e68-9b14-a3cd723aa3c8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:50.816943 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-cdfe9a87-5243-4e68-9b14-a3cd723aa3c8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:50.826026 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-cdfe9a87-5243-4e68-9b14-a3cd723aa3c8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:50.828551 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-cdfe9a87-5243-4e68-9b14-a3cd723aa3c8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:50.829752 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-cdfe9a87-5243-4e68-9b14-a3cd723aa3c8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0" status: 200 len: 1722 microversion: 2.20 time: 0.187459 Nov 02 14:44:50.830434 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 306/632] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:44:50 2022] GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:44:51.855944 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-ef8781d5-27b0-4e9d-8316-1b62348638b0 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:51.856556 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-ef8781d5-27b0-4e9d-8316-1b62348638b0 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:51.865180 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ef8781d5-27b0-4e9d-8316-1b62348638b0 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:51.865668 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ef8781d5-27b0-4e9d-8316-1b62348638b0 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:51.866111 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ef8781d5-27b0-4e9d-8316-1b62348638b0 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:51.866806 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ef8781d5-27b0-4e9d-8316-1b62348638b0 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:51.867636 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ef8781d5-27b0-4e9d-8316-1b62348638b0 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:51.867636 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ef8781d5-27b0-4e9d-8316-1b62348638b0 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:52.008974 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-ef8781d5-27b0-4e9d-8316-1b62348638b0 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:52.018582 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-ef8781d5-27b0-4e9d-8316-1b62348638b0 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:52.020029 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-ef8781d5-27b0-4e9d-8316-1b62348638b0 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:52.021284 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-ef8781d5-27b0-4e9d-8316-1b62348638b0 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0" status: 200 len: 1722 microversion: 2.20 time: 0.169315 Nov 02 14:44:52.021848 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 327/633] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:44:51 2022] GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:44:53.048578 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-32cf8183-d02e-4293-a501-6f147fe03c7c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:53.049888 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-32cf8183-d02e-4293-a501-6f147fe03c7c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:53.063047 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-32cf8183-d02e-4293-a501-6f147fe03c7c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:53.063843 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-32cf8183-d02e-4293-a501-6f147fe03c7c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:53.064454 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-32cf8183-d02e-4293-a501-6f147fe03c7c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:53.065400 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-32cf8183-d02e-4293-a501-6f147fe03c7c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:53.066018 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-32cf8183-d02e-4293-a501-6f147fe03c7c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:53.066659 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-32cf8183-d02e-4293-a501-6f147fe03c7c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:53.214223 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-32cf8183-d02e-4293-a501-6f147fe03c7c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:53.224899 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-32cf8183-d02e-4293-a501-6f147fe03c7c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:53.226553 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-32cf8183-d02e-4293-a501-6f147fe03c7c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:53.228059 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-32cf8183-d02e-4293-a501-6f147fe03c7c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0" status: 200 len: 1722 microversion: 2.20 time: 0.184331 Nov 02 14:44:53.229785 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 307/634] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:44:53 2022] GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:44:54.256225 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-ce28e7ca-d42c-4b15-9251-0e8eb948b922 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:54.256993 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-ce28e7ca-d42c-4b15-9251-0e8eb948b922 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:54.259456 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell0:SELECT=4 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:44:54.265871 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ce28e7ca-d42c-4b15-9251-0e8eb948b922 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:54.267177 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ce28e7ca-d42c-4b15-9251-0e8eb948b922 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:54.267177 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ce28e7ca-d42c-4b15-9251-0e8eb948b922 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:54.268176 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ce28e7ca-d42c-4b15-9251-0e8eb948b922 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:54.268641 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ce28e7ca-d42c-4b15-9251-0e8eb948b922 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:54.269097 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ce28e7ca-d42c-4b15-9251-0e8eb948b922 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:54.410505 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-ce28e7ca-d42c-4b15-9251-0e8eb948b922 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:54.419650 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-ce28e7ca-d42c-4b15-9251-0e8eb948b922 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:54.421847 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-ce28e7ca-d42c-4b15-9251-0e8eb948b922 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:54.422594 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-ce28e7ca-d42c-4b15-9251-0e8eb948b922 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0" status: 200 len: 1722 microversion: 2.20 time: 0.170335 Nov 02 14:44:54.423154 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 328/635] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:44:54 2022] GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:44:55.457895 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-df5ccdaa-6da9-4941-a465-0d3d3254fdff tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:55.458676 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-df5ccdaa-6da9-4941-a465-0d3d3254fdff tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:55.465776 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-df5ccdaa-6da9-4941-a465-0d3d3254fdff tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:55.466388 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-df5ccdaa-6da9-4941-a465-0d3d3254fdff tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:55.466945 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-df5ccdaa-6da9-4941-a465-0d3d3254fdff tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:55.468475 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-df5ccdaa-6da9-4941-a465-0d3d3254fdff tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:55.469027 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-df5ccdaa-6da9-4941-a465-0d3d3254fdff tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:55.469683 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-df5ccdaa-6da9-4941-a465-0d3d3254fdff tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:55.718577 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-df5ccdaa-6da9-4941-a465-0d3d3254fdff tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:55.732797 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-df5ccdaa-6da9-4941-a465-0d3d3254fdff tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:55.734808 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-df5ccdaa-6da9-4941-a465-0d3d3254fdff tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:55.736263 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-df5ccdaa-6da9-4941-a465-0d3d3254fdff tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0" status: 200 len: 1722 microversion: 2.20 time: 0.282732 Nov 02 14:44:55.737513 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 308/636] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:44:55 2022] GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 => generated 1722 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:44:56.763948 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-3d519ba6-6db2-465b-8bf2-ad1b54e8ef06 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:56.769027 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-3d519ba6-6db2-465b-8bf2-ad1b54e8ef06 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:56.775981 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3d519ba6-6db2-465b-8bf2-ad1b54e8ef06 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:56.776472 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3d519ba6-6db2-465b-8bf2-ad1b54e8ef06 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:56.776927 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3d519ba6-6db2-465b-8bf2-ad1b54e8ef06 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:56.777645 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3d519ba6-6db2-465b-8bf2-ad1b54e8ef06 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:56.778162 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3d519ba6-6db2-465b-8bf2-ad1b54e8ef06 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:56.778590 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3d519ba6-6db2-465b-8bf2-ad1b54e8ef06 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:57.047765 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-3d519ba6-6db2-465b-8bf2-ad1b54e8ef06 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:57.057887 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-3d519ba6-6db2-465b-8bf2-ad1b54e8ef06 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:57.061141 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-3d519ba6-6db2-465b-8bf2-ad1b54e8ef06 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:57.062727 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-3d519ba6-6db2-465b-8bf2-ad1b54e8ef06 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0" status: 200 len: 1722 microversion: 2.20 time: 0.303054 Nov 02 14:44:57.063695 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 329/637] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:44:56 2022] GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 => generated 1722 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:44:57.643213 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-8af28a96-d7be-4b7d-beac-d1277685e48a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Action: 'create', calling method: .version_select at 0x7fb24ecc5a60>, body: {"keypair": {"name": "tempest-keypair-551645791", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIEBLzDczVsE/l2e1OXkkfxhQkzJgNiv4rMYlg1SGGtP3jcpQOQ6ccNdZ3s7yRaAAYAqTY3bdDrEwlTjdho3yE2/6yT3vMosNsweKBo1x6ZqhJOFlJfw1r2wocM01uYdWQ=="}} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:44:57.670085 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.quota [None req-8af28a96-d7be-4b7d-beac-d1277685e48a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Getting quotas for project 2bf7381b1bf545c39936c96595aa36f4. Resources: {'key_pairs'} {{(pid=119658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:44:57.690534 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.quota [None req-8af28a96-d7be-4b7d-beac-d1277685e48a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Getting quotas for user 6069bdb19c5c42ff8546aef3197a6a2b and project 2bf7381b1bf545c39936c96595aa36f4. Resources: {'key_pairs'} {{(pid=119658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:44:57.802559 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-8af28a96-d7be-4b7d-beac-d1277685e48a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.285767 Nov 02 14:44:57.803197 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 309/638] 10.222.0.30 () {60 vars in 1159 bytes} [Wed Nov 2 14:44:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:44:58.088963 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-b7da2fb6-e783-47f1-a07d-09d1026b5c85 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:58.089680 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-b7da2fb6-e783-47f1-a07d-09d1026b5c85 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:58.096695 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b7da2fb6-e783-47f1-a07d-09d1026b5c85 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:58.097233 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b7da2fb6-e783-47f1-a07d-09d1026b5c85 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:58.097667 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b7da2fb6-e783-47f1-a07d-09d1026b5c85 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:58.098367 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b7da2fb6-e783-47f1-a07d-09d1026b5c85 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:58.098820 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b7da2fb6-e783-47f1-a07d-09d1026b5c85 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:58.099238 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b7da2fb6-e783-47f1-a07d-09d1026b5c85 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:58.526250 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-b7da2fb6-e783-47f1-a07d-09d1026b5c85 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:58.535037 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-b7da2fb6-e783-47f1-a07d-09d1026b5c85 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:58.536579 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-b7da2fb6-e783-47f1-a07d-09d1026b5c85 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:58.537754 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-b7da2fb6-e783-47f1-a07d-09d1026b5c85 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0" status: 200 len: 1743 microversion: 2.20 time: 0.452789 Nov 02 14:44:58.538350 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 330/639] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:44:58 2022] GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 => generated 1743 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:44:59.564732 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-8d486040-a386-4570-aee2-8a86d96c72de tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:59.565357 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-8d486040-a386-4570-aee2-8a86d96c72de tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:59.572004 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8d486040-a386-4570-aee2-8a86d96c72de tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:59.572487 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8d486040-a386-4570-aee2-8a86d96c72de tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:59.572921 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8d486040-a386-4570-aee2-8a86d96c72de tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:59.573833 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8d486040-a386-4570-aee2-8a86d96c72de tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:59.574285 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8d486040-a386-4570-aee2-8a86d96c72de tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:59.574708 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8d486040-a386-4570-aee2-8a86d96c72de tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:59.793190 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-8d486040-a386-4570-aee2-8a86d96c72de tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:59.812541 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-8d486040-a386-4570-aee2-8a86d96c72de tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:59.817174 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-8d486040-a386-4570-aee2-8a86d96c72de tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:59.820256 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-8d486040-a386-4570-aee2-8a86d96c72de tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0" status: 200 len: 1743 microversion: 2.20 time: 0.260359 Nov 02 14:44:59.821640 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 310/640] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:44:59 2022] GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 => generated 1743 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:45:00.266313 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-c4265521-6586-4aac-b95a-c88f81534a4e tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-115342759", "imageRef": "a726a246-cc7f-46e6-aeff-4d62e03cc091", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f4156324-b06b-4603-82b2-5bb54f75cf91"}], "security_groups": [{"name": "tempest-securitygroup--1846426954"}], "key_name": "tempest-keypair-551645791", "user_data": "}} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:45:00.405554 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.network.neutron [None req-c4265521-6586-4aac-b95a-c88f81534a4e tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] validate_networks() for [('f4156324-b06b-4603-82b2-5bb54f75cf91', None, None, None, None, None)] {{(pid=119659) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:45:00.854550 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-4f901a2d-0e27-4189-b55e-942a804a157e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:00.855171 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-4f901a2d-0e27-4189-b55e-942a804a157e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:00.871517 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4f901a2d-0e27-4189-b55e-942a804a157e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:00.872416 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4f901a2d-0e27-4189-b55e-942a804a157e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:00.873078 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4f901a2d-0e27-4189-b55e-942a804a157e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:00.874526 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4f901a2d-0e27-4189-b55e-942a804a157e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:00.875327 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4f901a2d-0e27-4189-b55e-942a804a157e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:00.875956 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4f901a2d-0e27-4189-b55e-942a804a157e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:01.194275 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-4f901a2d-0e27-4189-b55e-942a804a157e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:01.203807 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-4f901a2d-0e27-4189-b55e-942a804a157e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:01.205299 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-4f901a2d-0e27-4189-b55e-942a804a157e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:01.206501 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-4f901a2d-0e27-4189-b55e-942a804a157e tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0" status: 200 len: 1738 microversion: 2.20 time: 0.361131 Nov 02 14:45:01.207067 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 311/641] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:45:00 2022] GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 => generated 1738 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:45:01.251989 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.virt.hardware [None req-c4265521-6586-4aac-b95a-c88f81534a4e tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Flavor limits 0:0:0 {{(pid=119659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:45:01.252421 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.virt.hardware [None req-c4265521-6586-4aac-b95a-c88f81534a4e tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Image limits 0:0:0 {{(pid=119659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:45:01.252893 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.virt.hardware [None req-c4265521-6586-4aac-b95a-c88f81534a4e tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Flavor pref 0:0:0 {{(pid=119659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:45:01.253329 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.virt.hardware [None req-c4265521-6586-4aac-b95a-c88f81534a4e tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Image pref 0:0:0 {{(pid=119659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:45:01.253735 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.virt.hardware [None req-c4265521-6586-4aac-b95a-c88f81534a4e tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:45:01.272709 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c4265521-6586-4aac-b95a-c88f81534a4e tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:01.273386 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c4265521-6586-4aac-b95a-c88f81534a4e tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:01.276109 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c4265521-6586-4aac-b95a-c88f81534a4e tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:01.277068 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c4265521-6586-4aac-b95a-c88f81534a4e tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:01.277748 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c4265521-6586-4aac-b95a-c88f81534a4e tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:01.278347 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c4265521-6586-4aac-b95a-c88f81534a4e tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:01.297785 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.quota [None req-c4265521-6586-4aac-b95a-c88f81534a4e tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Getting quotas for project 2bf7381b1bf545c39936c96595aa36f4. Resources: {'instances', 'ram', 'cores'} {{(pid=119659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:45:01.302293 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.quota [None req-c4265521-6586-4aac-b95a-c88f81534a4e tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Getting quotas for user 6069bdb19c5c42ff8546aef3197a6a2b and project 2bf7381b1bf545c39936c96595aa36f4. Resources: {'instances', 'ram', 'cores'} {{(pid=119659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:45:01.315876 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-c4265521-6586-4aac-b95a-c88f81534a4e tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Going to run 1 instances... {{(pid=119659) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:45:01.318347 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-c4265521-6586-4aac-b95a-c88f81534a4e tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a726a246-cc7f-46e6-aeff-4d62e03cc091',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119659) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:45:01.495939 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-c4265521-6586-4aac-b95a-c88f81534a4e tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.236254 Nov 02 14:45:01.496713 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 331/642] 10.222.0.30 () {60 vars in 1147 bytes} [Wed Nov 2 14:45:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 1238 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 14:45:01.508909 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-80c24cc0-6899-4282-b086-384fdbcbb4d8 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:01.509771 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-80c24cc0-6899-4282-b086-384fdbcbb4d8 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:01.582033 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-80c24cc0-6899-4282-b086-384fdbcbb4d8 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:01.589669 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-80c24cc0-6899-4282-b086-384fdbcbb4d8 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290" status: 200 len: 1236 microversion: 2.1 time: 0.084774 Nov 02 14:45:01.590240 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 312/643] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:01 2022] GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290 => generated 1236 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:02.235768 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-a88068e5-2d21-4de3-95e0-e7cedd1c0700 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:02.236736 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-a88068e5-2d21-4de3-95e0-e7cedd1c0700 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:02.246045 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a88068e5-2d21-4de3-95e0-e7cedd1c0700 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:02.247104 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a88068e5-2d21-4de3-95e0-e7cedd1c0700 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:02.248034 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a88068e5-2d21-4de3-95e0-e7cedd1c0700 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:02.249587 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a88068e5-2d21-4de3-95e0-e7cedd1c0700 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:02.250292 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a88068e5-2d21-4de3-95e0-e7cedd1c0700 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:02.250944 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a88068e5-2d21-4de3-95e0-e7cedd1c0700 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:02.454994 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-a88068e5-2d21-4de3-95e0-e7cedd1c0700 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:02.466068 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-a88068e5-2d21-4de3-95e0-e7cedd1c0700 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:02.468308 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-a88068e5-2d21-4de3-95e0-e7cedd1c0700 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:02.469795 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-a88068e5-2d21-4de3-95e0-e7cedd1c0700 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0" status: 200 len: 1738 microversion: 2.20 time: 0.238181 Nov 02 14:45:02.475520 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 332/644] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:45:02 2022] GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 => generated 1738 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:45:02.499304 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [req-86c35ba0-e8c6-4b36-96ea-b8798a023b9a req-896c386a-f8aa-429a-9a23-47fea7d3a00d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea6a4066-de22-411b-9e4b-1531cb199bc0", "name": "network-vif-plugged", "status": "completed", "tag": "bdb24aef-c8c8-4727-9d59-dbef941eb4f8"}]} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:45:02.514679 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-86c35ba0-e8c6-4b36-96ea-b8798a023b9a req-896c386a-f8aa-429a-9a23-47fea7d3a00d service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:02.515251 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-86c35ba0-e8c6-4b36-96ea-b8798a023b9a req-896c386a-f8aa-429a-9a23-47fea7d3a00d service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:02.515686 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-86c35ba0-e8c6-4b36-96ea-b8798a023b9a req-896c386a-f8aa-429a-9a23-47fea7d3a00d service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:02.527833 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.compute.server_external_events [req-86c35ba0-e8c6-4b36-96ea-b8798a023b9a req-896c386a-f8aa-429a-9a23-47fea7d3a00d service nova] Creating event network-vif-plugged:bdb24aef-c8c8-4727-9d59-dbef941eb4f8 for instance ea6a4066-de22-411b-9e4b-1531cb199bc0 on hv-cinder-86236 Nov 02 14:45:02.535976 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [req-86c35ba0-e8c6-4b36-96ea-b8798a023b9a req-896c386a-f8aa-429a-9a23-47fea7d3a00d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040381 Nov 02 14:45:02.536701 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 313/645] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:45:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:45:02.614455 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-27a3dc38-bd5b-4ead-8bf9-ab28abc0905c tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:02.616084 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-27a3dc38-bd5b-4ead-8bf9-ab28abc0905c tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:02.684970 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-27a3dc38-bd5b-4ead-8bf9-ab28abc0905c tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:02.706125 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-27a3dc38-bd5b-4ead-8bf9-ab28abc0905c tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290" status: 200 len: 1236 microversion: 2.1 time: 0.098150 Nov 02 14:45:02.706732 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 333/646] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:02 2022] GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290 => generated 1236 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:02.954657 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-ee195cd5-d788-477b-9a7d-f08ddade651e tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-908412579", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-667872314", "security_groups": [{"name": "tempest-secgroup-smoke-744571343"}], "block_device_mapping_v2": [{"uuid": "438f680d-f3cd-4bc9-ade4-2be0195d65a3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3f9be41b-3ac6-43ae-b64c-2573362419af"}]}} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:45:03.129493 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.network.neutron [None req-ee195cd5-d788-477b-9a7d-f08ddade651e tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] validate_networks() for [('3f9be41b-3ac6-43ae-b64c-2573362419af', None, None, None, None, None)] {{(pid=119658) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:45:03.501877 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-37d1ac8e-d9fd-4b1b-8f91-1208f63cd4aa tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:03.503953 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-37d1ac8e-d9fd-4b1b-8f91-1208f63cd4aa tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:03.517492 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-37d1ac8e-d9fd-4b1b-8f91-1208f63cd4aa tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:03.520832 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-37d1ac8e-d9fd-4b1b-8f91-1208f63cd4aa tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:03.522447 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-37d1ac8e-d9fd-4b1b-8f91-1208f63cd4aa tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:03.523360 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-37d1ac8e-d9fd-4b1b-8f91-1208f63cd4aa tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:03.525356 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-37d1ac8e-d9fd-4b1b-8f91-1208f63cd4aa tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:03.526539 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-37d1ac8e-d9fd-4b1b-8f91-1208f63cd4aa tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:03.741672 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-ee195cd5-d788-477b-9a7d-f08ddade651e tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Flavor limits 0:0:0 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:45:03.742260 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-ee195cd5-d788-477b-9a7d-f08ddade651e tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Image limits 0:0:0 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:45:03.742579 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-ee195cd5-d788-477b-9a7d-f08ddade651e tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Flavor pref 0:0:0 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:45:03.742989 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-ee195cd5-d788-477b-9a7d-f08ddade651e tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Image pref 0:0:0 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:45:03.743405 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-ee195cd5-d788-477b-9a7d-f08ddade651e tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:45:03.745521 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:45:03.754567 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ee195cd5-d788-477b-9a7d-f08ddade651e tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:03.755497 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ee195cd5-d788-477b-9a7d-f08ddade651e tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:03.756124 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ee195cd5-d788-477b-9a7d-f08ddade651e tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:03.757172 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ee195cd5-d788-477b-9a7d-f08ddade651e tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:03.757851 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ee195cd5-d788-477b-9a7d-f08ddade651e tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:03.758269 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ee195cd5-d788-477b-9a7d-f08ddade651e tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:03.779278 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.quota [None req-ee195cd5-d788-477b-9a7d-f08ddade651e tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Getting quotas for project 990b7e753ad1450489668d0ca151736e. Resources: {'instances', 'ram', 'cores'} {{(pid=119658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:45:03.788964 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-37d1ac8e-d9fd-4b1b-8f91-1208f63cd4aa tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:03.797208 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.quota [None req-ee195cd5-d788-477b-9a7d-f08ddade651e tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Getting quotas for user 6f0516ac4c6648f9b208a89e174da3a3 and project 990b7e753ad1450489668d0ca151736e. Resources: {'instances', 'ram', 'cores'} {{(pid=119658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:45:03.801244 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-37d1ac8e-d9fd-4b1b-8f91-1208f63cd4aa tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:03.802910 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-37d1ac8e-d9fd-4b1b-8f91-1208f63cd4aa tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:03.805095 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-37d1ac8e-d9fd-4b1b-8f91-1208f63cd4aa tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0" status: 200 len: 1738 microversion: 2.20 time: 0.309050 Nov 02 14:45:03.809079 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 334/647] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:45:03 2022] GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 => generated 1738 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:45:03.814870 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-7e0410a0-8553-4554-ae4f-de5fe8fd49eb tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:03.819575 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-7e0410a0-8553-4554-ae4f-de5fe8fd49eb tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:03.832191 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7e0410a0-8553-4554-ae4f-de5fe8fd49eb tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:03.833476 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7e0410a0-8553-4554-ae4f-de5fe8fd49eb tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:03.834123 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7e0410a0-8553-4554-ae4f-de5fe8fd49eb tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:03.835050 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7e0410a0-8553-4554-ae4f-de5fe8fd49eb tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:03.835661 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7e0410a0-8553-4554-ae4f-de5fe8fd49eb tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:03.836268 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7e0410a0-8553-4554-ae4f-de5fe8fd49eb tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:03.925373 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-ee195cd5-d788-477b-9a7d-f08ddade651e tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Going to run 1 instances... {{(pid=119658) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:45:03.928658 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-ee195cd5-d788-477b-9a7d-f08ddade651e tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: a70e0509-33cf-40a8-a0e2-a5da4317522c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='438f680d-f3cd-4bc9-ade4-2be0195d65a3',volume_size=None,volume_type=None)] {{(pid=119658) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:45:03.942438 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-7e0410a0-8553-4554-ae4f-de5fe8fd49eb tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:03.955633 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-7e0410a0-8553-4554-ae4f-de5fe8fd49eb tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290" status: 200 len: 1288 microversion: 2.1 time: 0.145164 Nov 02 14:45:03.956938 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 335/648] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:03 2022] GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290 => generated 1288 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:04.840136 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-a5673fee-c458-4d5c-80db-022840d0ea93 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:04.840899 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-a5673fee-c458-4d5c-80db-022840d0ea93 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:04.847737 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a5673fee-c458-4d5c-80db-022840d0ea93 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:04.848221 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a5673fee-c458-4d5c-80db-022840d0ea93 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:04.848657 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a5673fee-c458-4d5c-80db-022840d0ea93 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:04.849615 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a5673fee-c458-4d5c-80db-022840d0ea93 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:04.850059 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a5673fee-c458-4d5c-80db-022840d0ea93 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:04.850484 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a5673fee-c458-4d5c-80db-022840d0ea93 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:04.955329 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-ee195cd5-d788-477b-9a7d-f08ddade651e tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.007291 Nov 02 14:45:04.963563 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 314/649] 10.222.0.30 () {60 vars in 1147 bytes} [Wed Nov 2 14:45:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 2017 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:45:04.973912 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-a40569a6-dc5d-4129-bae5-6905fa8421aa tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:04.973912 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-a40569a6-dc5d-4129-bae5-6905fa8421aa tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: a70e0509-33cf-40a8-a0e2-a5da4317522c] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:05.038788 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-a40569a6-dc5d-4129-bae5-6905fa8421aa tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:05.047203 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-a40569a6-dc5d-4129-bae5-6905fa8421aa tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c" status: 200 len: 1093 microversion: 2.1 time: 0.082833 Nov 02 14:45:05.048715 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 315/650] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:04 2022] GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c => generated 1093 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:05.057154 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-a5673fee-c458-4d5c-80db-022840d0ea93 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:05.062444 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-a5673fee-c458-4d5c-80db-022840d0ea93 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:05.064393 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-a5673fee-c458-4d5c-80db-022840d0ea93 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:05.066048 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-76bb28cf-11c1-489c-b798-15d9ea16e216 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:05.066311 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-a5673fee-c458-4d5c-80db-022840d0ea93 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0" status: 200 len: 1738 microversion: 2.20 time: 0.230009 Nov 02 14:45:05.066841 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-76bb28cf-11c1-489c-b798-15d9ea16e216 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:05.073947 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-76bb28cf-11c1-489c-b798-15d9ea16e216 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:05.074439 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-76bb28cf-11c1-489c-b798-15d9ea16e216 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:05.074884 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-76bb28cf-11c1-489c-b798-15d9ea16e216 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:05.075594 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-76bb28cf-11c1-489c-b798-15d9ea16e216 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:05.076052 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-76bb28cf-11c1-489c-b798-15d9ea16e216 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:05.077066 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-76bb28cf-11c1-489c-b798-15d9ea16e216 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:05.079959 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 336/651] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:45:04 2022] GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 => generated 1738 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:45:05.143035 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-76bb28cf-11c1-489c-b798-15d9ea16e216 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:05.151278 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-76bb28cf-11c1-489c-b798-15d9ea16e216 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290" status: 200 len: 1296 microversion: 2.1 time: 0.092561 Nov 02 14:45:05.151955 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 316/652] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:05 2022] GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290 => generated 1296 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:06.074768 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-aa743dfe-b6ea-406b-9a0d-7d8a4e308a54 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:06.075280 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-aa743dfe-b6ea-406b-9a0d-7d8a4e308a54 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: a70e0509-33cf-40a8-a0e2-a5da4317522c] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:06.095135 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-f0ff68ab-83ef-4059-a0f4-a9f217cbb622 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:06.098177 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-f0ff68ab-83ef-4059-a0f4-a9f217cbb622 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:06.106499 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f0ff68ab-83ef-4059-a0f4-a9f217cbb622 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:06.106998 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f0ff68ab-83ef-4059-a0f4-a9f217cbb622 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:06.107437 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f0ff68ab-83ef-4059-a0f4-a9f217cbb622 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:06.108199 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f0ff68ab-83ef-4059-a0f4-a9f217cbb622 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:06.114366 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f0ff68ab-83ef-4059-a0f4-a9f217cbb622 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:06.114948 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f0ff68ab-83ef-4059-a0f4-a9f217cbb622 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:06.161769 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-aa743dfe-b6ea-406b-9a0d-7d8a4e308a54 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:06.173018 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-aa743dfe-b6ea-406b-9a0d-7d8a4e308a54 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c" status: 200 len: 1093 microversion: 2.1 time: 0.098791 Nov 02 14:45:06.180355 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 337/653] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:06 2022] GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c => generated 1093 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:06.183921 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-2e6e5228-afad-42f9-874a-bf814b0be06e tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:06.184758 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-2e6e5228-afad-42f9-874a-bf814b0be06e tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:06.196191 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2e6e5228-afad-42f9-874a-bf814b0be06e tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:06.200626 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2e6e5228-afad-42f9-874a-bf814b0be06e tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:06.201303 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2e6e5228-afad-42f9-874a-bf814b0be06e tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:06.202837 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2e6e5228-afad-42f9-874a-bf814b0be06e tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:06.203465 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2e6e5228-afad-42f9-874a-bf814b0be06e tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:06.204077 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2e6e5228-afad-42f9-874a-bf814b0be06e tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:06.514053 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-f0ff68ab-83ef-4059-a0f4-a9f217cbb622 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:06.550106 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-f0ff68ab-83ef-4059-a0f4-a9f217cbb622 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:06.555849 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-f0ff68ab-83ef-4059-a0f4-a9f217cbb622 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:06.558994 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-f0ff68ab-83ef-4059-a0f4-a9f217cbb622 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0" status: 200 len: 1738 microversion: 2.20 time: 0.468524 Nov 02 14:45:06.564071 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 317/654] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:45:06 2022] GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 => generated 1738 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:45:06.565071 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-2e6e5228-afad-42f9-874a-bf814b0be06e tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:06.575931 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-2e6e5228-afad-42f9-874a-bf814b0be06e tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290" status: 200 len: 1362 microversion: 2.1 time: 0.400337 Nov 02 14:45:06.577977 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 338/655] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:06 2022] GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290 => generated 1362 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:07.202201 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-ccb19411-f6b7-4adc-a909-dc420698725b tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:07.203634 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-ccb19411-f6b7-4adc-a909-dc420698725b tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: a70e0509-33cf-40a8-a0e2-a5da4317522c] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:07.210848 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ccb19411-f6b7-4adc-a909-dc420698725b tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:07.211699 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ccb19411-f6b7-4adc-a909-dc420698725b tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:07.212380 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ccb19411-f6b7-4adc-a909-dc420698725b tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:07.213409 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ccb19411-f6b7-4adc-a909-dc420698725b tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:07.213959 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ccb19411-f6b7-4adc-a909-dc420698725b tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:07.222694 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ccb19411-f6b7-4adc-a909-dc420698725b tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:07.320591 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-ccb19411-f6b7-4adc-a909-dc420698725b tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:07.330465 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-ccb19411-f6b7-4adc-a909-dc420698725b tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c" status: 200 len: 1191 microversion: 2.1 time: 0.131925 Nov 02 14:45:07.331044 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 318/656] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:07 2022] GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c => generated 1191 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:07.353262 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [req-d24e0986-2768-4d69-8d7e-5aa021e8a3ef req-16099296-1cca-4821-ab80-80783414f80b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dff2e06-ddf6-4c7a-8887-40092f0f9290", "tag": "dbd39cbf-326e-49d0-90e6-27faedce220f"}]} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:45:07.364318 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:45:07.368300 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-d24e0986-2768-4d69-8d7e-5aa021e8a3ef req-16099296-1cca-4821-ab80-80783414f80b service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:07.368779 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-d24e0986-2768-4d69-8d7e-5aa021e8a3ef req-16099296-1cca-4821-ab80-80783414f80b service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:07.369242 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-d24e0986-2768-4d69-8d7e-5aa021e8a3ef req-16099296-1cca-4821-ab80-80783414f80b service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:07.384420 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.compute.server_external_events [req-d24e0986-2768-4d69-8d7e-5aa021e8a3ef req-16099296-1cca-4821-ab80-80783414f80b service nova] Creating event network-changed:dbd39cbf-326e-49d0-90e6-27faedce220f for instance 9dff2e06-ddf6-4c7a-8887-40092f0f9290 on hv-cinder-86236 Nov 02 14:45:07.390620 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [req-d24e0986-2768-4d69-8d7e-5aa021e8a3ef req-16099296-1cca-4821-ab80-80783414f80b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158410 Nov 02 14:45:07.391811 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 339/657] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:45:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:45:07.591968 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-e6c11efb-e52f-4f0d-b60a-d1eca2b6d62c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:07.593989 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-e6c11efb-e52f-4f0d-b60a-d1eca2b6d62c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:07.604203 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e6c11efb-e52f-4f0d-b60a-d1eca2b6d62c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:07.604706 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e6c11efb-e52f-4f0d-b60a-d1eca2b6d62c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:07.605205 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e6c11efb-e52f-4f0d-b60a-d1eca2b6d62c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:07.605375 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-e2777464-6cc5-493f-bc74-c1ec347ba9e7 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:07.605901 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-e2777464-6cc5-493f-bc74-c1ec347ba9e7 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:07.606252 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e6c11efb-e52f-4f0d-b60a-d1eca2b6d62c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:07.606734 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e6c11efb-e52f-4f0d-b60a-d1eca2b6d62c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:07.607142 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e6c11efb-e52f-4f0d-b60a-d1eca2b6d62c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:07.617485 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e2777464-6cc5-493f-bc74-c1ec347ba9e7 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:07.624765 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e2777464-6cc5-493f-bc74-c1ec347ba9e7 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:07.625619 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e2777464-6cc5-493f-bc74-c1ec347ba9e7 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:07.626692 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e2777464-6cc5-493f-bc74-c1ec347ba9e7 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:07.627462 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e2777464-6cc5-493f-bc74-c1ec347ba9e7 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:07.628076 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e2777464-6cc5-493f-bc74-c1ec347ba9e7 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:07.939452 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-e6c11efb-e52f-4f0d-b60a-d1eca2b6d62c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:07.948067 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-e6c11efb-e52f-4f0d-b60a-d1eca2b6d62c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:07.957879 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-e6c11efb-e52f-4f0d-b60a-d1eca2b6d62c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:07.959261 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-e6c11efb-e52f-4f0d-b60a-d1eca2b6d62c tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0" status: 200 len: 1738 microversion: 2.20 time: 0.371353 Nov 02 14:45:07.959955 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 319/658] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:45:07 2022] GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 => generated 1738 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:45:08.023922 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-e2777464-6cc5-493f-bc74-c1ec347ba9e7 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:08.037931 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-e2777464-6cc5-493f-bc74-c1ec347ba9e7 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290" status: 200 len: 1362 microversion: 2.1 time: 0.438227 Nov 02 14:45:08.054588 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 340/659] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:07 2022] GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290 => generated 1362 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:08.355122 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-662f1167-45cc-49f2-a9a3-8b0576444cf6 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:08.355735 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-662f1167-45cc-49f2-a9a3-8b0576444cf6 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: a70e0509-33cf-40a8-a0e2-a5da4317522c] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:08.364124 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-662f1167-45cc-49f2-a9a3-8b0576444cf6 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:08.364778 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-662f1167-45cc-49f2-a9a3-8b0576444cf6 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:08.373202 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-662f1167-45cc-49f2-a9a3-8b0576444cf6 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:08.373202 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-662f1167-45cc-49f2-a9a3-8b0576444cf6 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:08.373202 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-662f1167-45cc-49f2-a9a3-8b0576444cf6 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:08.373202 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-662f1167-45cc-49f2-a9a3-8b0576444cf6 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:08.450627 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-662f1167-45cc-49f2-a9a3-8b0576444cf6 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:08.462022 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-662f1167-45cc-49f2-a9a3-8b0576444cf6 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c" status: 200 len: 1209 microversion: 2.1 time: 0.110849 Nov 02 14:45:08.462664 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 320/660] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:08 2022] GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c => generated 1209 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:08.985233 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-a46e43aa-29be-4892-8db1-3ee587d66294 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:08.985826 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-a46e43aa-29be-4892-8db1-3ee587d66294 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:08.992649 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a46e43aa-29be-4892-8db1-3ee587d66294 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:08.993157 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a46e43aa-29be-4892-8db1-3ee587d66294 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:08.993660 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a46e43aa-29be-4892-8db1-3ee587d66294 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:08.994313 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a46e43aa-29be-4892-8db1-3ee587d66294 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:08.994764 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a46e43aa-29be-4892-8db1-3ee587d66294 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:08.995182 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a46e43aa-29be-4892-8db1-3ee587d66294 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:09.064817 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-2aefb4e8-4b86-451a-810f-29a76aae7733 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:09.065538 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-2aefb4e8-4b86-451a-810f-29a76aae7733 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:09.072348 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2aefb4e8-4b86-451a-810f-29a76aae7733 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:09.072496 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2aefb4e8-4b86-451a-810f-29a76aae7733 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:09.072880 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2aefb4e8-4b86-451a-810f-29a76aae7733 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:09.073651 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2aefb4e8-4b86-451a-810f-29a76aae7733 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:09.074123 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2aefb4e8-4b86-451a-810f-29a76aae7733 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:09.074764 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2aefb4e8-4b86-451a-810f-29a76aae7733 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:09.168517 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-a46e43aa-29be-4892-8db1-3ee587d66294 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:09.182365 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-a46e43aa-29be-4892-8db1-3ee587d66294 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:09.184412 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-a46e43aa-29be-4892-8db1-3ee587d66294 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:09.185053 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-a46e43aa-29be-4892-8db1-3ee587d66294 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0" status: 200 len: 1738 microversion: 2.20 time: 0.203764 Nov 02 14:45:09.185598 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 341/661] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:45:08 2022] GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 => generated 1738 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:45:09.261947 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-2aefb4e8-4b86-451a-810f-29a76aae7733 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:09.278702 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-2aefb4e8-4b86-451a-810f-29a76aae7733 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290" status: 200 len: 1362 microversion: 2.1 time: 0.218537 Nov 02 14:45:09.280549 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 321/662] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:09 2022] GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290 => generated 1362 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:45:09.487045 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-2ac3322e-2509-4a03-a036-6c903fac11b3 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:09.487909 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-2ac3322e-2509-4a03-a036-6c903fac11b3 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: a70e0509-33cf-40a8-a0e2-a5da4317522c] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:09.506281 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2ac3322e-2509-4a03-a036-6c903fac11b3 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:09.506281 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2ac3322e-2509-4a03-a036-6c903fac11b3 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:09.506281 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2ac3322e-2509-4a03-a036-6c903fac11b3 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:09.506281 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2ac3322e-2509-4a03-a036-6c903fac11b3 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:09.506653 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2ac3322e-2509-4a03-a036-6c903fac11b3 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:09.506653 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2ac3322e-2509-4a03-a036-6c903fac11b3 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:09.516558 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell1:SELECT=100 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:45:09.673309 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-2ac3322e-2509-4a03-a036-6c903fac11b3 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:09.682902 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-2ac3322e-2509-4a03-a036-6c903fac11b3 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c" status: 200 len: 1276 microversion: 2.1 time: 0.199658 Nov 02 14:45:09.683688 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 342/663] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:09 2022] GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c => generated 1276 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:45:10.216359 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-138b0552-d92a-416a-b58d-0e1d6943e7bc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:10.218399 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-138b0552-d92a-416a-b58d-0e1d6943e7bc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:10.226305 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-138b0552-d92a-416a-b58d-0e1d6943e7bc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:10.227030 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-138b0552-d92a-416a-b58d-0e1d6943e7bc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:10.228311 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-138b0552-d92a-416a-b58d-0e1d6943e7bc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:10.229380 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-138b0552-d92a-416a-b58d-0e1d6943e7bc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:10.229832 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-138b0552-d92a-416a-b58d-0e1d6943e7bc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:10.230430 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-138b0552-d92a-416a-b58d-0e1d6943e7bc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:10.304719 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-d8dfc17d-3362-4bc3-8d89-e832f1cab949 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:10.307072 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-d8dfc17d-3362-4bc3-8d89-e832f1cab949 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:10.318238 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d8dfc17d-3362-4bc3-8d89-e832f1cab949 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:10.318929 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d8dfc17d-3362-4bc3-8d89-e832f1cab949 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:10.319510 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d8dfc17d-3362-4bc3-8d89-e832f1cab949 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:10.320299 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d8dfc17d-3362-4bc3-8d89-e832f1cab949 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:10.320795 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d8dfc17d-3362-4bc3-8d89-e832f1cab949 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:10.321447 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d8dfc17d-3362-4bc3-8d89-e832f1cab949 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:10.501640 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-138b0552-d92a-416a-b58d-0e1d6943e7bc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:10.522057 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-138b0552-d92a-416a-b58d-0e1d6943e7bc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:10.527075 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-138b0552-d92a-416a-b58d-0e1d6943e7bc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:10.528695 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-138b0552-d92a-416a-b58d-0e1d6943e7bc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0" status: 200 len: 1738 microversion: 2.20 time: 0.316398 Nov 02 14:45:10.533517 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 322/664] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:45:10 2022] GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 => generated 1738 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:45:10.563754 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-d8dfc17d-3362-4bc3-8d89-e832f1cab949 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:10.577783 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-d8dfc17d-3362-4bc3-8d89-e832f1cab949 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290" status: 200 len: 1362 microversion: 2.1 time: 0.277565 Nov 02 14:45:10.579497 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 343/665] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:10 2022] GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290 => generated 1362 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:10.710060 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-160d904e-29f0-4823-aa11-8caa3664747d tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:10.711088 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-160d904e-29f0-4823-aa11-8caa3664747d tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: a70e0509-33cf-40a8-a0e2-a5da4317522c] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:10.718444 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-160d904e-29f0-4823-aa11-8caa3664747d tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:10.719280 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-160d904e-29f0-4823-aa11-8caa3664747d tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:10.719880 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-160d904e-29f0-4823-aa11-8caa3664747d tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:10.720796 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-160d904e-29f0-4823-aa11-8caa3664747d tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:10.721613 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-160d904e-29f0-4823-aa11-8caa3664747d tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:10.724004 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-160d904e-29f0-4823-aa11-8caa3664747d tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:10.729172 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:45:10.900813 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-160d904e-29f0-4823-aa11-8caa3664747d tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:10.911460 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-160d904e-29f0-4823-aa11-8caa3664747d tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c" status: 200 len: 1264 microversion: 2.1 time: 0.204538 Nov 02 14:45:10.933733 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 323/666] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:10 2022] GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c => generated 1264 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:11.026466 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [req-2a7bf17a-8f72-4b26-953d-678015fa58f5 req-9151ecf8-2abb-42e1-95ce-4a1c2586fa37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a70e0509-33cf-40a8-a0e2-a5da4317522c", "tag": "31597016-abf2-4436-a570-4e0d25351888"}]} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:45:11.048233 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-2a7bf17a-8f72-4b26-953d-678015fa58f5 req-9151ecf8-2abb-42e1-95ce-4a1c2586fa37 service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:11.049027 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-2a7bf17a-8f72-4b26-953d-678015fa58f5 req-9151ecf8-2abb-42e1-95ce-4a1c2586fa37 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:11.049468 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-2a7bf17a-8f72-4b26-953d-678015fa58f5 req-9151ecf8-2abb-42e1-95ce-4a1c2586fa37 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:11.061822 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.compute.server_external_events [req-2a7bf17a-8f72-4b26-953d-678015fa58f5 req-9151ecf8-2abb-42e1-95ce-4a1c2586fa37 service nova] Creating event network-changed:31597016-abf2-4436-a570-4e0d25351888 for instance a70e0509-33cf-40a8-a0e2-a5da4317522c on hv-cinder-86236 Nov 02 14:45:11.067728 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [req-2a7bf17a-8f72-4b26-953d-678015fa58f5 req-9151ecf8-2abb-42e1-95ce-4a1c2586fa37 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140363 Nov 02 14:45:11.069098 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 344/667] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:45:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:45:11.562661 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-daa88d3f-17a7-454a-9a56-b5e5ef841699 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:11.563474 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-daa88d3f-17a7-454a-9a56-b5e5ef841699 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:11.573661 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-daa88d3f-17a7-454a-9a56-b5e5ef841699 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:11.579269 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-daa88d3f-17a7-454a-9a56-b5e5ef841699 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:11.579269 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-daa88d3f-17a7-454a-9a56-b5e5ef841699 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:11.579269 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-daa88d3f-17a7-454a-9a56-b5e5ef841699 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:11.579269 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-daa88d3f-17a7-454a-9a56-b5e5ef841699 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:11.579619 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-daa88d3f-17a7-454a-9a56-b5e5ef841699 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:11.612234 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-946393a9-c002-4742-8597-d3e217be6095 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:11.613320 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-946393a9-c002-4742-8597-d3e217be6095 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:11.620530 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell0:SELECT=2 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:45:11.623263 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-946393a9-c002-4742-8597-d3e217be6095 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:11.624090 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-946393a9-c002-4742-8597-d3e217be6095 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:11.624876 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-946393a9-c002-4742-8597-d3e217be6095 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:11.635553 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-946393a9-c002-4742-8597-d3e217be6095 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:11.636429 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-946393a9-c002-4742-8597-d3e217be6095 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:11.636990 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-946393a9-c002-4742-8597-d3e217be6095 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:11.837435 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-daa88d3f-17a7-454a-9a56-b5e5ef841699 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:11.847755 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-daa88d3f-17a7-454a-9a56-b5e5ef841699 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:11.849496 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-daa88d3f-17a7-454a-9a56-b5e5ef841699 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:11.851176 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-daa88d3f-17a7-454a-9a56-b5e5ef841699 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0" status: 200 len: 1738 microversion: 2.20 time: 0.293078 Nov 02 14:45:11.852017 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 324/668] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:45:11 2022] GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 => generated 1738 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:45:11.878989 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-946393a9-c002-4742-8597-d3e217be6095 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:11.892731 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-946393a9-c002-4742-8597-d3e217be6095 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290" status: 200 len: 1362 microversion: 2.1 time: 0.285404 Nov 02 14:45:11.893944 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 345/669] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:11 2022] GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290 => generated 1362 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:11.941426 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-deace33a-6dd5-4462-b188-8f2e2a659043 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:11.942588 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-deace33a-6dd5-4462-b188-8f2e2a659043 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: a70e0509-33cf-40a8-a0e2-a5da4317522c] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:11.951979 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-deace33a-6dd5-4462-b188-8f2e2a659043 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:11.951979 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-deace33a-6dd5-4462-b188-8f2e2a659043 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:11.954425 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-deace33a-6dd5-4462-b188-8f2e2a659043 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:11.954425 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-deace33a-6dd5-4462-b188-8f2e2a659043 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:11.954767 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-deace33a-6dd5-4462-b188-8f2e2a659043 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:11.955146 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-deace33a-6dd5-4462-b188-8f2e2a659043 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:12.141467 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-deace33a-6dd5-4462-b188-8f2e2a659043 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:12.150081 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-deace33a-6dd5-4462-b188-8f2e2a659043 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c" status: 200 len: 1264 microversion: 2.1 time: 0.212806 Nov 02 14:45:12.150789 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 325/670] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:11 2022] GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c => generated 1264 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:12.881876 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-f4489940-e5cc-42cb-b365-b8e72da243ff tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:12.882507 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-f4489940-e5cc-42cb-b365-b8e72da243ff tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:12.906972 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f4489940-e5cc-42cb-b365-b8e72da243ff tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:12.907459 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f4489940-e5cc-42cb-b365-b8e72da243ff tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:12.907907 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f4489940-e5cc-42cb-b365-b8e72da243ff tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:12.908986 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f4489940-e5cc-42cb-b365-b8e72da243ff tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:12.909172 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f4489940-e5cc-42cb-b365-b8e72da243ff tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:12.909605 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f4489940-e5cc-42cb-b365-b8e72da243ff tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:12.916967 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-1934893e-679c-44d6-85e4-721158ca9134 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:12.917730 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-1934893e-679c-44d6-85e4-721158ca9134 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:12.926655 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1934893e-679c-44d6-85e4-721158ca9134 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:12.927429 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1934893e-679c-44d6-85e4-721158ca9134 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:12.928029 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1934893e-679c-44d6-85e4-721158ca9134 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:12.928916 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1934893e-679c-44d6-85e4-721158ca9134 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:12.929578 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1934893e-679c-44d6-85e4-721158ca9134 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:12.930519 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1934893e-679c-44d6-85e4-721158ca9134 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:13.428994 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-1934893e-679c-44d6-85e4-721158ca9134 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:13.433030 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-f4489940-e5cc-42cb-b365-b8e72da243ff tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:13.437521 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-1934893e-679c-44d6-85e4-721158ca9134 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290" status: 200 len: 1362 microversion: 2.1 time: 0.524174 Nov 02 14:45:13.438074 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 326/671] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:12 2022] GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290 => generated 1362 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:45:13.442446 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-f4489940-e5cc-42cb-b365-b8e72da243ff tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:13.442625 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-0445f26e-16e9-45a1-8e8b-edda6e18634a tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:13.443122 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-0445f26e-16e9-45a1-8e8b-edda6e18634a tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: a70e0509-33cf-40a8-a0e2-a5da4317522c] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:13.443921 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-f4489940-e5cc-42cb-b365-b8e72da243ff tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:13.445308 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-f4489940-e5cc-42cb-b365-b8e72da243ff tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0" status: 200 len: 1738 microversion: 2.20 time: 0.570226 Nov 02 14:45:13.446396 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 346/672] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:45:12 2022] GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 => generated 1738 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:45:13.449141 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0445f26e-16e9-45a1-8e8b-edda6e18634a tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:13.449632 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0445f26e-16e9-45a1-8e8b-edda6e18634a tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:13.450075 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0445f26e-16e9-45a1-8e8b-edda6e18634a tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:13.450789 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0445f26e-16e9-45a1-8e8b-edda6e18634a tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:13.451232 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0445f26e-16e9-45a1-8e8b-edda6e18634a tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:13.451770 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0445f26e-16e9-45a1-8e8b-edda6e18634a tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:13.588426 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-0445f26e-16e9-45a1-8e8b-edda6e18634a tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:13.597151 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-0445f26e-16e9-45a1-8e8b-edda6e18634a tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c" status: 200 len: 1264 microversion: 2.1 time: 0.158056 Nov 02 14:45:13.597712 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 327/673] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:13 2022] GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:14.481411 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-fdfffd0f-94a8-4c83-a4e9-f37526e1b556 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:14.484127 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-5fffad43-d859-4616-bd6a-9a5892e4681f tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:14.485371 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-fdfffd0f-94a8-4c83-a4e9-f37526e1b556 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:14.488205 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-5fffad43-d859-4616-bd6a-9a5892e4681f tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:14.491553 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell0:SELECT=2 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:45:14.502138 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fdfffd0f-94a8-4c83-a4e9-f37526e1b556 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:14.503050 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fdfffd0f-94a8-4c83-a4e9-f37526e1b556 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:14.503675 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fdfffd0f-94a8-4c83-a4e9-f37526e1b556 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:14.506315 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fdfffd0f-94a8-4c83-a4e9-f37526e1b556 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:14.507716 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5fffad43-d859-4616-bd6a-9a5892e4681f tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:14.511792 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fdfffd0f-94a8-4c83-a4e9-f37526e1b556 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:14.511792 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fdfffd0f-94a8-4c83-a4e9-f37526e1b556 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:14.512068 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5fffad43-d859-4616-bd6a-9a5892e4681f tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:14.512330 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5fffad43-d859-4616-bd6a-9a5892e4681f tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:14.513123 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5fffad43-d859-4616-bd6a-9a5892e4681f tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:14.513635 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5fffad43-d859-4616-bd6a-9a5892e4681f tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:14.514340 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5fffad43-d859-4616-bd6a-9a5892e4681f tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:14.742453 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-fdfffd0f-94a8-4c83-a4e9-f37526e1b556 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:14.750425 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-5fffad43-d859-4616-bd6a-9a5892e4681f tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:14.754126 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-fdfffd0f-94a8-4c83-a4e9-f37526e1b556 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:14.756214 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-fdfffd0f-94a8-4c83-a4e9-f37526e1b556 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:14.757721 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-fdfffd0f-94a8-4c83-a4e9-f37526e1b556 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0" status: 200 len: 1720 microversion: 2.20 time: 0.285752 Nov 02 14:45:14.759277 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 347/674] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:45:14 2022] GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 => generated 1720 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:45:14.760695 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-5fffad43-d859-4616-bd6a-9a5892e4681f tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290" status: 200 len: 1362 microversion: 2.1 time: 0.286824 Nov 02 14:45:14.761504 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 328/675] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:14 2022] GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290 => generated 1362 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:14.774336 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-f5728c1e-e892-42cc-9b43-bfeb0a179af4 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:14.775251 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-f5728c1e-e892-42cc-9b43-bfeb0a179af4 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: a70e0509-33cf-40a8-a0e2-a5da4317522c] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:14.786142 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f5728c1e-e892-42cc-9b43-bfeb0a179af4 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:14.786996 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f5728c1e-e892-42cc-9b43-bfeb0a179af4 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:14.791664 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f5728c1e-e892-42cc-9b43-bfeb0a179af4 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:14.791664 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f5728c1e-e892-42cc-9b43-bfeb0a179af4 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:14.791664 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f5728c1e-e892-42cc-9b43-bfeb0a179af4 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:14.799179 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f5728c1e-e892-42cc-9b43-bfeb0a179af4 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:14.854794 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [req-1b3ff313-d80a-42b3-b493-4395a3f5c245 req-dff1ab80-0c9d-4a25-aaa5-c27d3557520c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dff2e06-ddf6-4c7a-8887-40092f0f9290", "name": "network-vif-plugged", "status": "completed", "tag": "dbd39cbf-326e-49d0-90e6-27faedce220f"}]} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:45:14.865878 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-1b3ff313-d80a-42b3-b493-4395a3f5c245 req-dff1ab80-0c9d-4a25-aaa5-c27d3557520c service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:14.866354 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-1b3ff313-d80a-42b3-b493-4395a3f5c245 req-dff1ab80-0c9d-4a25-aaa5-c27d3557520c service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:14.867013 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-1b3ff313-d80a-42b3-b493-4395a3f5c245 req-dff1ab80-0c9d-4a25-aaa5-c27d3557520c service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:14.880443 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.compute.server_external_events [req-1b3ff313-d80a-42b3-b493-4395a3f5c245 req-dff1ab80-0c9d-4a25-aaa5-c27d3557520c service nova] Creating event network-vif-plugged:dbd39cbf-326e-49d0-90e6-27faedce220f for instance 9dff2e06-ddf6-4c7a-8887-40092f0f9290 on hv-cinder-86236 Nov 02 14:45:14.886284 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [req-1b3ff313-d80a-42b3-b493-4395a3f5c245 req-dff1ab80-0c9d-4a25-aaa5-c27d3557520c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125684 Nov 02 14:45:14.886901 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 348/676] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:45:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:45:14.948630 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-f5728c1e-e892-42cc-9b43-bfeb0a179af4 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:14.956681 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-f5728c1e-e892-42cc-9b43-bfeb0a179af4 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c" status: 200 len: 1264 microversion: 2.1 time: 0.194017 Nov 02 14:45:14.957278 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 329/677] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:14 2022] GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c => generated 1264 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:15.801033 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-06596290-ff69-4da6-b094-3d954b3249dc tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:15.801761 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-06596290-ff69-4da6-b094-3d954b3249dc tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:15.801881 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-caf9fa61-0931-4906-a0c9-5302e2373793 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:15.802483 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-caf9fa61-0931-4906-a0c9-5302e2373793 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:15.804321 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell0:SELECT=14 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:45:15.808428 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-06596290-ff69-4da6-b094-3d954b3249dc tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:15.808909 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-06596290-ff69-4da6-b094-3d954b3249dc tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:15.809362 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-06596290-ff69-4da6-b094-3d954b3249dc tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:15.809515 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-caf9fa61-0931-4906-a0c9-5302e2373793 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:15.810005 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-caf9fa61-0931-4906-a0c9-5302e2373793 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:15.810106 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-06596290-ff69-4da6-b094-3d954b3249dc tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:15.810445 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-caf9fa61-0931-4906-a0c9-5302e2373793 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:15.810552 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-06596290-ff69-4da6-b094-3d954b3249dc tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:15.811764 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-06596290-ff69-4da6-b094-3d954b3249dc tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:15.811896 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-caf9fa61-0931-4906-a0c9-5302e2373793 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:15.812323 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-caf9fa61-0931-4906-a0c9-5302e2373793 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:15.812757 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-caf9fa61-0931-4906-a0c9-5302e2373793 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:16.010375 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-caf9fa61-0931-4906-a0c9-5302e2373793 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:16.013572 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-06596290-ff69-4da6-b094-3d954b3249dc tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:16.019201 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-caf9fa61-0931-4906-a0c9-5302e2373793 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:16.020691 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-caf9fa61-0931-4906-a0c9-5302e2373793 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:16.021893 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-caf9fa61-0931-4906-a0c9-5302e2373793 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0" status: 200 len: 1720 microversion: 2.20 time: 0.223833 Nov 02 14:45:16.022012 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-06596290-ff69-4da6-b094-3d954b3249dc tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290" status: 200 len: 1362 microversion: 2.1 time: 0.225168 Nov 02 14:45:16.022455 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 330/678] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:45:15 2022] GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 => generated 1720 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:45:16.025369 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 349/679] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:15 2022] GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290 => generated 1362 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:16.026981 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-14ab43fd-d568-4eef-9fd7-bbb2a1af70ed tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:16.027594 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-14ab43fd-d568-4eef-9fd7-bbb2a1af70ed tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: a70e0509-33cf-40a8-a0e2-a5da4317522c] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:16.034446 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-14ab43fd-d568-4eef-9fd7-bbb2a1af70ed tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:16.034999 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-14ab43fd-d568-4eef-9fd7-bbb2a1af70ed tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:16.035443 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-14ab43fd-d568-4eef-9fd7-bbb2a1af70ed tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:16.036197 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-14ab43fd-d568-4eef-9fd7-bbb2a1af70ed tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:16.036651 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-14ab43fd-d568-4eef-9fd7-bbb2a1af70ed tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:16.037153 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-14ab43fd-d568-4eef-9fd7-bbb2a1af70ed tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:16.168217 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-14ab43fd-d568-4eef-9fd7-bbb2a1af70ed tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:16.176723 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-14ab43fd-d568-4eef-9fd7-bbb2a1af70ed tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c" status: 200 len: 1264 microversion: 2.1 time: 0.153273 Nov 02 14:45:16.179378 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 331/680] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:16 2022] GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:16.903226 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [req-cd32be86-f4d3-46a1-a75d-a3fec04098f1 req-a4509f36-c3ae-45ce-9221-d85eee688990 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea6a4066-de22-411b-9e4b-1531cb199bc0", "name": "network-vif-unplugged", "status": "completed", "tag": "bdb24aef-c8c8-4727-9d59-dbef941eb4f8"}]} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:45:16.908292 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell0:SELECT=10 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:45:16.913484 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-cd32be86-f4d3-46a1-a75d-a3fec04098f1 req-a4509f36-c3ae-45ce-9221-d85eee688990 service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:16.913953 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-cd32be86-f4d3-46a1-a75d-a3fec04098f1 req-a4509f36-c3ae-45ce-9221-d85eee688990 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:16.914376 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-cd32be86-f4d3-46a1-a75d-a3fec04098f1 req-a4509f36-c3ae-45ce-9221-d85eee688990 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:16.925813 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.compute.server_external_events [req-cd32be86-f4d3-46a1-a75d-a3fec04098f1 req-a4509f36-c3ae-45ce-9221-d85eee688990 service nova] Creating event network-vif-unplugged:bdb24aef-c8c8-4727-9d59-dbef941eb4f8 for instance ea6a4066-de22-411b-9e4b-1531cb199bc0 on hv-cinder-86236 Nov 02 14:45:16.930961 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [req-cd32be86-f4d3-46a1-a75d-a3fec04098f1 req-a4509f36-c3ae-45ce-9221-d85eee688990 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031404 Nov 02 14:45:16.931578 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 350/681] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:45:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:45:17.046800 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-ad754d4b-b8f1-431f-8e2b-f1c18d94dcec tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:17.047403 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-ad754d4b-b8f1-431f-8e2b-f1c18d94dcec tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:17.049097 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-da71d488-dd31-4b35-ae6c-7e58e5ca3c2f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:17.049796 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-da71d488-dd31-4b35-ae6c-7e58e5ca3c2f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:17.053885 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ad754d4b-b8f1-431f-8e2b-f1c18d94dcec tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:17.054369 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ad754d4b-b8f1-431f-8e2b-f1c18d94dcec tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:17.054809 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ad754d4b-b8f1-431f-8e2b-f1c18d94dcec tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:17.055500 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ad754d4b-b8f1-431f-8e2b-f1c18d94dcec tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:17.055952 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ad754d4b-b8f1-431f-8e2b-f1c18d94dcec tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:17.056113 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-da71d488-dd31-4b35-ae6c-7e58e5ca3c2f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:17.056373 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ad754d4b-b8f1-431f-8e2b-f1c18d94dcec tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:17.056595 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-da71d488-dd31-4b35-ae6c-7e58e5ca3c2f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:17.057058 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-da71d488-dd31-4b35-ae6c-7e58e5ca3c2f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:17.057751 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-da71d488-dd31-4b35-ae6c-7e58e5ca3c2f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:17.058281 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-da71d488-dd31-4b35-ae6c-7e58e5ca3c2f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:17.058772 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-da71d488-dd31-4b35-ae6c-7e58e5ca3c2f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:17.255289 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-ad754d4b-b8f1-431f-8e2b-f1c18d94dcec tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:17.258840 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-da71d488-dd31-4b35-ae6c-7e58e5ca3c2f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:17.262851 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-ad754d4b-b8f1-431f-8e2b-f1c18d94dcec tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290" status: 200 len: 1362 microversion: 2.1 time: 0.220762 Nov 02 14:45:17.263428 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 332/682] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:17 2022] GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290 => generated 1362 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:17.267272 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-da71d488-dd31-4b35-ae6c-7e58e5ca3c2f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:17.268181 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-0ea26fc2-290f-4472-a58c-ad3bddb2c38d tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:17.268707 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-da71d488-dd31-4b35-ae6c-7e58e5ca3c2f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:17.268844 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-0ea26fc2-290f-4472-a58c-ad3bddb2c38d tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: a70e0509-33cf-40a8-a0e2-a5da4317522c] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:17.269882 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-da71d488-dd31-4b35-ae6c-7e58e5ca3c2f tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0" status: 200 len: 1723 microversion: 2.20 time: 0.226005 Nov 02 14:45:17.270737 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 351/683] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:45:17 2022] GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:45:17.274933 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0ea26fc2-290f-4472-a58c-ad3bddb2c38d tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:17.275420 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0ea26fc2-290f-4472-a58c-ad3bddb2c38d tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:17.275860 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0ea26fc2-290f-4472-a58c-ad3bddb2c38d tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:17.276536 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0ea26fc2-290f-4472-a58c-ad3bddb2c38d tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:17.276980 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0ea26fc2-290f-4472-a58c-ad3bddb2c38d tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:17.277420 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0ea26fc2-290f-4472-a58c-ad3bddb2c38d tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:17.296189 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-9488a48c-d37a-4cd4-b0ae-39b031110c30 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e619c14-0ebb-42dd-8a2d-c78d00b428a3"}} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:45:17.298523 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-9488a48c-d37a-4cd4-b0ae-39b031110c30 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:17.304290 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9488a48c-d37a-4cd4-b0ae-39b031110c30 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:17.304773 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9488a48c-d37a-4cd4-b0ae-39b031110c30 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:17.305433 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9488a48c-d37a-4cd4-b0ae-39b031110c30 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:17.306131 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9488a48c-d37a-4cd4-b0ae-39b031110c30 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:17.306598 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9488a48c-d37a-4cd4-b0ae-39b031110c30 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:17.307020 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9488a48c-d37a-4cd4-b0ae-39b031110c30 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:17.416754 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-0ea26fc2-290f-4472-a58c-ad3bddb2c38d tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:17.425545 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-0ea26fc2-290f-4472-a58c-ad3bddb2c38d tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c" status: 200 len: 1264 microversion: 2.1 time: 0.161111 Nov 02 14:45:17.426114 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 333/684] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:17 2022] GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:18.251436 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-9488a48c-d37a-4cd4-b0ae-39b031110c30 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "POST /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.959638 Nov 02 14:45:18.252071 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 352/685] 10.222.0.30 () {62 vars in 1364 bytes} [Wed Nov 2 14:45:17 2022] POST /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0/os-volume_attachments => generated 188 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 14:45:18.286923 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-964675ce-f44f-4664-ab28-61dc34626e90 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:18.287675 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-964675ce-f44f-4664-ab28-61dc34626e90 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:18.313638 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-964675ce-f44f-4664-ab28-61dc34626e90 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:18.313638 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-964675ce-f44f-4664-ab28-61dc34626e90 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:18.313638 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-964675ce-f44f-4664-ab28-61dc34626e90 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:18.313638 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-964675ce-f44f-4664-ab28-61dc34626e90 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:18.314618 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-964675ce-f44f-4664-ab28-61dc34626e90 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:18.314618 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-964675ce-f44f-4664-ab28-61dc34626e90 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:18.408881 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-07766067-b7b5-4ac5-80a3-d2012e28f487 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:18.409735 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-07766067-b7b5-4ac5-80a3-d2012e28f487 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:18.415735 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-07766067-b7b5-4ac5-80a3-d2012e28f487 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:18.416216 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-07766067-b7b5-4ac5-80a3-d2012e28f487 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:18.416676 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-07766067-b7b5-4ac5-80a3-d2012e28f487 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:18.417409 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-07766067-b7b5-4ac5-80a3-d2012e28f487 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:18.417991 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-07766067-b7b5-4ac5-80a3-d2012e28f487 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:18.418465 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-07766067-b7b5-4ac5-80a3-d2012e28f487 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:18.445893 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-964675ce-f44f-4664-ab28-61dc34626e90 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:18.455169 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-964675ce-f44f-4664-ab28-61dc34626e90 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290" status: 200 len: 1549 microversion: 2.1 time: 0.172682 Nov 02 14:45:18.455748 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 334/686] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:18 2022] GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290 => generated 1549 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:18.473044 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-c38345ac-bdd8-40b9-9f2e-eae8e3597ee0 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:18.474003 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-c38345ac-bdd8-40b9-9f2e-eae8e3597ee0 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: a70e0509-33cf-40a8-a0e2-a5da4317522c] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:18.481402 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c38345ac-bdd8-40b9-9f2e-eae8e3597ee0 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:18.481898 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c38345ac-bdd8-40b9-9f2e-eae8e3597ee0 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:18.482344 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c38345ac-bdd8-40b9-9f2e-eae8e3597ee0 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:18.483179 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c38345ac-bdd8-40b9-9f2e-eae8e3597ee0 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:18.483651 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c38345ac-bdd8-40b9-9f2e-eae8e3597ee0 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:18.484065 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c38345ac-bdd8-40b9-9f2e-eae8e3597ee0 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:18.640729 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-c38345ac-bdd8-40b9-9f2e-eae8e3597ee0 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:18.648725 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-c38345ac-bdd8-40b9-9f2e-eae8e3597ee0 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c" status: 200 len: 1264 microversion: 2.1 time: 0.181468 Nov 02 14:45:18.653675 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 335/687] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:18 2022] GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c => generated 1264 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:18.654050 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-71839f7d-6de6-4881-9be8-4fbd1fbee53a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:18.655148 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-71839f7d-6de6-4881-9be8-4fbd1fbee53a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:18.660851 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-71839f7d-6de6-4881-9be8-4fbd1fbee53a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:18.661380 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-71839f7d-6de6-4881-9be8-4fbd1fbee53a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:18.661822 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-71839f7d-6de6-4881-9be8-4fbd1fbee53a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:18.662514 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-71839f7d-6de6-4881-9be8-4fbd1fbee53a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:18.662968 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-71839f7d-6de6-4881-9be8-4fbd1fbee53a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:18.663396 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-71839f7d-6de6-4881-9be8-4fbd1fbee53a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:18.744700 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-71839f7d-6de6-4881-9be8-4fbd1fbee53a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094267 Nov 02 14:45:18.745472 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 336/688] 10.222.0.30 () {58 vars in 1275 bytes} [Wed Nov 2 14:45:18 2022] GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:45:19.091056 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-07766067-b7b5-4ac5-80a3-d2012e28f487 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0/os-volume_attachments/9e619c14-0ebb-42dd-8a2d-c78d00b428a3" status: 202 len: 0 microversion: 2.20 time: 0.686463 Nov 02 14:45:19.092614 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 353/689] 10.222.0.30 () {60 vars in 1457 bytes} [Wed Nov 2 14:45:18 2022] DELETE /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0/os-volume_attachments/9e619c14-0ebb-42dd-8a2d-c78d00b428a3 => generated 0 bytes in 689 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 02 14:45:19.162937 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-efaa195e-362d-44d5-8540-086dcaa68dc6 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:45:19.163609 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-efaa195e-362d-44d5-8540-086dcaa68dc6 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:19.169594 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-efaa195e-362d-44d5-8540-086dcaa68dc6 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:19.170277 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-efaa195e-362d-44d5-8540-086dcaa68dc6 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:19.170859 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-efaa195e-362d-44d5-8540-086dcaa68dc6 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:19.171591 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-efaa195e-362d-44d5-8540-086dcaa68dc6 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:19.172055 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-efaa195e-362d-44d5-8540-086dcaa68dc6 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:19.172505 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-efaa195e-362d-44d5-8540-086dcaa68dc6 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:19.215954 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-efaa195e-362d-44d5-8540-086dcaa68dc6 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119658) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Nov 02 14:45:19.505932 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-efaa195e-362d-44d5-8540-086dcaa68dc6 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "POST /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0/action" status: 202 len: 0 microversion: 2.20 time: 0.346998 Nov 02 14:45:19.506949 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 337/690] 10.222.0.30 () {62 vars in 1319 bytes} [Wed Nov 2 14:45:19 2022] POST /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0/action => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:45:19.514838 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-0cc1a2b0-5d08-4e59-923e-0cbce50daa2b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:19.515454 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-0cc1a2b0-5d08-4e59-923e-0cbce50daa2b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:19.521782 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0cc1a2b0-5d08-4e59-923e-0cbce50daa2b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:19.522267 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0cc1a2b0-5d08-4e59-923e-0cbce50daa2b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:19.522728 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0cc1a2b0-5d08-4e59-923e-0cbce50daa2b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:19.523888 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0cc1a2b0-5d08-4e59-923e-0cbce50daa2b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:19.523888 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0cc1a2b0-5d08-4e59-923e-0cbce50daa2b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:19.524280 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0cc1a2b0-5d08-4e59-923e-0cbce50daa2b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:19.666016 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-0cc1a2b0-5d08-4e59-923e-0cbce50daa2b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:19.672785 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-0d6d0280-662e-49bd-b336-9e9348a510e7 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:19.673431 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-0d6d0280-662e-49bd-b336-9e9348a510e7 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: a70e0509-33cf-40a8-a0e2-a5da4317522c] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:19.675310 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-0cc1a2b0-5d08-4e59-923e-0cbce50daa2b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:19.676758 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-0cc1a2b0-5d08-4e59-923e-0cbce50daa2b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:19.677948 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-0cc1a2b0-5d08-4e59-923e-0cbce50daa2b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0" status: 200 len: 1671 microversion: 2.20 time: 0.167285 Nov 02 14:45:19.679998 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0d6d0280-662e-49bd-b336-9e9348a510e7 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:19.680487 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0d6d0280-662e-49bd-b336-9e9348a510e7 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:19.680918 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0d6d0280-662e-49bd-b336-9e9348a510e7 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:19.681751 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0d6d0280-662e-49bd-b336-9e9348a510e7 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:19.682145 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0d6d0280-662e-49bd-b336-9e9348a510e7 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:19.682568 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0d6d0280-662e-49bd-b336-9e9348a510e7 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:19.689768 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 354/691] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:45:19 2022] GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 => generated 1671 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:45:19.812456 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [req-070b581b-8c14-4345-87e5-99cc06e661f3 req-ede5c8fe-b45a-4e53-bbb7-f14d09f95bb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dff2e06-ddf6-4c7a-8887-40092f0f9290", "tag": "dbd39cbf-326e-49d0-90e6-27faedce220f"}]} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:45:19.822349 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-070b581b-8c14-4345-87e5-99cc06e661f3 req-ede5c8fe-b45a-4e53-bbb7-f14d09f95bb8 service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:19.823248 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-070b581b-8c14-4345-87e5-99cc06e661f3 req-ede5c8fe-b45a-4e53-bbb7-f14d09f95bb8 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:19.823884 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-070b581b-8c14-4345-87e5-99cc06e661f3 req-ede5c8fe-b45a-4e53-bbb7-f14d09f95bb8 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:19.834605 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-0d6d0280-662e-49bd-b336-9e9348a510e7 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:19.836978 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.compute.server_external_events [req-070b581b-8c14-4345-87e5-99cc06e661f3 req-ede5c8fe-b45a-4e53-bbb7-f14d09f95bb8 service nova] Creating event network-changed:dbd39cbf-326e-49d0-90e6-27faedce220f for instance 9dff2e06-ddf6-4c7a-8887-40092f0f9290 on hv-cinder-86236 Nov 02 14:45:19.842499 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [req-070b581b-8c14-4345-87e5-99cc06e661f3 req-ede5c8fe-b45a-4e53-bbb7-f14d09f95bb8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033942 Nov 02 14:45:19.843781 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 355/692] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:45:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:45:19.844010 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-0d6d0280-662e-49bd-b336-9e9348a510e7 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c" status: 200 len: 1264 microversion: 2.1 time: 0.176050 Nov 02 14:45:19.844797 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 338/693] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:19 2022] GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c => generated 1264 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:45:20.705608 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-84b11bd6-02c9-4fb3-b002-26b810b987c4 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:20.706330 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-84b11bd6-02c9-4fb3-b002-26b810b987c4 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:20.712949 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-84b11bd6-02c9-4fb3-b002-26b810b987c4 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:20.713806 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-84b11bd6-02c9-4fb3-b002-26b810b987c4 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:20.713971 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-84b11bd6-02c9-4fb3-b002-26b810b987c4 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:20.714669 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-84b11bd6-02c9-4fb3-b002-26b810b987c4 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:20.715115 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-84b11bd6-02c9-4fb3-b002-26b810b987c4 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:20.715539 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-84b11bd6-02c9-4fb3-b002-26b810b987c4 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:20.742170 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:45:20.867619 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-da76a86d-4179-4ca5-939c-2b84af459042 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:20.874585 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-84b11bd6-02c9-4fb3-b002-26b810b987c4 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:20.875791 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-da76a86d-4179-4ca5-939c-2b84af459042 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: a70e0509-33cf-40a8-a0e2-a5da4317522c] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:20.884345 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-da76a86d-4179-4ca5-939c-2b84af459042 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:20.889301 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-da76a86d-4179-4ca5-939c-2b84af459042 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:20.890420 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-da76a86d-4179-4ca5-939c-2b84af459042 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:20.891353 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-da76a86d-4179-4ca5-939c-2b84af459042 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:20.892156 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-da76a86d-4179-4ca5-939c-2b84af459042 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:20.892621 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-da76a86d-4179-4ca5-939c-2b84af459042 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:20.893619 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-84b11bd6-02c9-4fb3-b002-26b810b987c4 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:20.895092 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-84b11bd6-02c9-4fb3-b002-26b810b987c4 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:20.896012 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:45:20.896940 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-84b11bd6-02c9-4fb3-b002-26b810b987c4 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0" status: 200 len: 1671 microversion: 2.20 time: 0.196905 Nov 02 14:45:20.897530 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 356/694] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:45:20 2022] GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 => generated 1671 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:45:21.050165 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-da76a86d-4179-4ca5-939c-2b84af459042 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:21.057926 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-da76a86d-4179-4ca5-939c-2b84af459042 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c" status: 200 len: 1264 microversion: 2.1 time: 0.194900 Nov 02 14:45:21.058493 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 339/695] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:20 2022] GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c => generated 1264 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:21.927680 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-ebaf1ebd-6a49-41ae-97a1-dbba4af99ad7 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:21.928470 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-ebaf1ebd-6a49-41ae-97a1-dbba4af99ad7 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:21.936135 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ebaf1ebd-6a49-41ae-97a1-dbba4af99ad7 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:21.936792 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ebaf1ebd-6a49-41ae-97a1-dbba4af99ad7 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:21.937373 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ebaf1ebd-6a49-41ae-97a1-dbba4af99ad7 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:21.938922 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ebaf1ebd-6a49-41ae-97a1-dbba4af99ad7 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:21.939491 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ebaf1ebd-6a49-41ae-97a1-dbba4af99ad7 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:21.940028 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ebaf1ebd-6a49-41ae-97a1-dbba4af99ad7 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:22.081050 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-a6f0aa85-611b-4e58-a3c0-2deb738f41ae tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:22.083158 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-a6f0aa85-611b-4e58-a3c0-2deb738f41ae tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: a70e0509-33cf-40a8-a0e2-a5da4317522c] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:22.091533 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a6f0aa85-611b-4e58-a3c0-2deb738f41ae tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:22.092710 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a6f0aa85-611b-4e58-a3c0-2deb738f41ae tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:22.093451 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a6f0aa85-611b-4e58-a3c0-2deb738f41ae tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:22.094393 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a6f0aa85-611b-4e58-a3c0-2deb738f41ae tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:22.095190 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a6f0aa85-611b-4e58-a3c0-2deb738f41ae tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:22.095865 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a6f0aa85-611b-4e58-a3c0-2deb738f41ae tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:22.105513 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-ebaf1ebd-6a49-41ae-97a1-dbba4af99ad7 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:22.114964 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-ebaf1ebd-6a49-41ae-97a1-dbba4af99ad7 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:22.116421 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-ebaf1ebd-6a49-41ae-97a1-dbba4af99ad7 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:22.117622 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-ebaf1ebd-6a49-41ae-97a1-dbba4af99ad7 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0" status: 200 len: 1729 microversion: 2.20 time: 0.194430 Nov 02 14:45:22.118182 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 357/696] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:45:21 2022] GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 => generated 1729 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:45:22.234986 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-a6f0aa85-611b-4e58-a3c0-2deb738f41ae tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:22.242837 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-a6f0aa85-611b-4e58-a3c0-2deb738f41ae tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c" status: 200 len: 1264 microversion: 2.1 time: 0.165742 Nov 02 14:45:22.245199 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 340/697] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:22 2022] GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:45:22.529324 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [req-aa9f66b9-49c9-44df-b85c-f7a83ded3cb0 req-12823449-1169-4c26-8eec-e162bbcdbc2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a70e0509-33cf-40a8-a0e2-a5da4317522c", "name": "network-vif-plugged", "status": "completed", "tag": "31597016-abf2-4436-a570-4e0d25351888"}]} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:45:22.539753 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-aa9f66b9-49c9-44df-b85c-f7a83ded3cb0 req-12823449-1169-4c26-8eec-e162bbcdbc2f service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:22.540232 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-aa9f66b9-49c9-44df-b85c-f7a83ded3cb0 req-12823449-1169-4c26-8eec-e162bbcdbc2f service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:22.540662 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-aa9f66b9-49c9-44df-b85c-f7a83ded3cb0 req-12823449-1169-4c26-8eec-e162bbcdbc2f service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:22.552084 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.compute.server_external_events [req-aa9f66b9-49c9-44df-b85c-f7a83ded3cb0 req-12823449-1169-4c26-8eec-e162bbcdbc2f service nova] Creating event network-vif-plugged:31597016-abf2-4436-a570-4e0d25351888 for instance a70e0509-33cf-40a8-a0e2-a5da4317522c on hv-cinder-86236 Nov 02 14:45:22.556870 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [req-aa9f66b9-49c9-44df-b85c-f7a83ded3cb0 req-12823449-1169-4c26-8eec-e162bbcdbc2f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031445 Nov 02 14:45:22.557529 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 358/698] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:45:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:45:23.144734 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-c658c403-4a06-4b5e-b0aa-88acc0148562 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:23.145394 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-c658c403-4a06-4b5e-b0aa-88acc0148562 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:23.152161 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c658c403-4a06-4b5e-b0aa-88acc0148562 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:23.152648 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c658c403-4a06-4b5e-b0aa-88acc0148562 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:23.153115 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c658c403-4a06-4b5e-b0aa-88acc0148562 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:23.153966 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c658c403-4a06-4b5e-b0aa-88acc0148562 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:23.155195 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c658c403-4a06-4b5e-b0aa-88acc0148562 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:23.155750 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c658c403-4a06-4b5e-b0aa-88acc0148562 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:23.267302 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-c0cc6e48-3356-44af-b1aa-c93bef778c07 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:23.267991 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-c0cc6e48-3356-44af-b1aa-c93bef778c07 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: a70e0509-33cf-40a8-a0e2-a5da4317522c] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:23.277993 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c0cc6e48-3356-44af-b1aa-c93bef778c07 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:23.278645 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c0cc6e48-3356-44af-b1aa-c93bef778c07 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:23.289682 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c0cc6e48-3356-44af-b1aa-c93bef778c07 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:23.290608 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c0cc6e48-3356-44af-b1aa-c93bef778c07 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:23.291400 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c0cc6e48-3356-44af-b1aa-c93bef778c07 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:23.291942 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c0cc6e48-3356-44af-b1aa-c93bef778c07 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:23.309204 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-c658c403-4a06-4b5e-b0aa-88acc0148562 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:23.321208 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-c658c403-4a06-4b5e-b0aa-88acc0148562 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:23.322704 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-c658c403-4a06-4b5e-b0aa-88acc0148562 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:23.324090 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-c658c403-4a06-4b5e-b0aa-88acc0148562 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0" status: 200 len: 1729 microversion: 2.20 time: 0.183337 Nov 02 14:45:23.325189 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 341/699] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:45:23 2022] GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 => generated 1729 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:45:23.449590 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-c0cc6e48-3356-44af-b1aa-c93bef778c07 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:23.458522 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-c0cc6e48-3356-44af-b1aa-c93bef778c07 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c" status: 200 len: 1264 microversion: 2.1 time: 0.196389 Nov 02 14:45:23.459185 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 359/700] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:23 2022] GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c => generated 1264 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:24.354709 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-4875dd69-f1ee-4c72-b7c3-c577b2c65d01 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:24.355734 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-4875dd69-f1ee-4c72-b7c3-c577b2c65d01 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:24.365413 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4875dd69-f1ee-4c72-b7c3-c577b2c65d01 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:24.366310 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4875dd69-f1ee-4c72-b7c3-c577b2c65d01 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:24.367185 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4875dd69-f1ee-4c72-b7c3-c577b2c65d01 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:24.368072 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4875dd69-f1ee-4c72-b7c3-c577b2c65d01 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:24.368892 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4875dd69-f1ee-4c72-b7c3-c577b2c65d01 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:24.369697 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4875dd69-f1ee-4c72-b7c3-c577b2c65d01 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:24.481918 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-1346adfa-fa39-4bbf-8e74-de9dbb1fab77 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:24.483154 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-1346adfa-fa39-4bbf-8e74-de9dbb1fab77 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: a70e0509-33cf-40a8-a0e2-a5da4317522c] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:24.490080 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1346adfa-fa39-4bbf-8e74-de9dbb1fab77 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:24.490902 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1346adfa-fa39-4bbf-8e74-de9dbb1fab77 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:24.491561 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1346adfa-fa39-4bbf-8e74-de9dbb1fab77 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:24.492485 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1346adfa-fa39-4bbf-8e74-de9dbb1fab77 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:24.493181 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1346adfa-fa39-4bbf-8e74-de9dbb1fab77 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:24.493901 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1346adfa-fa39-4bbf-8e74-de9dbb1fab77 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:24.519244 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-4875dd69-f1ee-4c72-b7c3-c577b2c65d01 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:24.530657 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-4875dd69-f1ee-4c72-b7c3-c577b2c65d01 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:24.532684 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-4875dd69-f1ee-4c72-b7c3-c577b2c65d01 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:24.534153 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-4875dd69-f1ee-4c72-b7c3-c577b2c65d01 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0" status: 200 len: 1729 microversion: 2.20 time: 0.186400 Nov 02 14:45:24.550240 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 342/701] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:45:24 2022] GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 => generated 1729 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:45:24.646602 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-1346adfa-fa39-4bbf-8e74-de9dbb1fab77 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:24.656011 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-1346adfa-fa39-4bbf-8e74-de9dbb1fab77 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c" status: 200 len: 1264 microversion: 2.1 time: 0.177942 Nov 02 14:45:24.656602 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 360/702] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:24 2022] GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c => generated 1264 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:25.575881 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-eff29e7e-6b92-48cc-938d-2b1837f94ede tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:25.577260 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-eff29e7e-6b92-48cc-938d-2b1837f94ede tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:25.583833 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-eff29e7e-6b92-48cc-938d-2b1837f94ede tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:25.584320 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-eff29e7e-6b92-48cc-938d-2b1837f94ede tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:25.584756 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-eff29e7e-6b92-48cc-938d-2b1837f94ede tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:25.585472 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-eff29e7e-6b92-48cc-938d-2b1837f94ede tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:25.585923 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-eff29e7e-6b92-48cc-938d-2b1837f94ede tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:25.586344 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-eff29e7e-6b92-48cc-938d-2b1837f94ede tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:25.678219 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-452c8973-cfdb-460b-91f9-f8fb1576a9c4 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:25.678824 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-452c8973-cfdb-460b-91f9-f8fb1576a9c4 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: a70e0509-33cf-40a8-a0e2-a5da4317522c] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:25.686510 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-452c8973-cfdb-460b-91f9-f8fb1576a9c4 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:25.687398 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-452c8973-cfdb-460b-91f9-f8fb1576a9c4 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:25.688061 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-452c8973-cfdb-460b-91f9-f8fb1576a9c4 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:25.689022 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-452c8973-cfdb-460b-91f9-f8fb1576a9c4 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:25.689699 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-452c8973-cfdb-460b-91f9-f8fb1576a9c4 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:25.690360 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-452c8973-cfdb-460b-91f9-f8fb1576a9c4 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:25.779687 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-eff29e7e-6b92-48cc-938d-2b1837f94ede tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:25.794018 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-eff29e7e-6b92-48cc-938d-2b1837f94ede tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:25.796483 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-eff29e7e-6b92-48cc-938d-2b1837f94ede tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:25.797695 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-eff29e7e-6b92-48cc-938d-2b1837f94ede tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0" status: 200 len: 1729 microversion: 2.20 time: 0.225852 Nov 02 14:45:25.799257 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 343/703] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:45:25 2022] GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 => generated 1729 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:45:25.874640 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-452c8973-cfdb-460b-91f9-f8fb1576a9c4 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:25.882684 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-452c8973-cfdb-460b-91f9-f8fb1576a9c4 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c" status: 200 len: 1264 microversion: 2.1 time: 0.208134 Nov 02 14:45:25.897710 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 361/704] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:25 2022] GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c => generated 1264 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:45:26.823897 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-efc28d92-d598-43f6-8e27-c2b226cdefac tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:26.824484 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-efc28d92-d598-43f6-8e27-c2b226cdefac tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:26.830946 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-efc28d92-d598-43f6-8e27-c2b226cdefac tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:26.831430 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-efc28d92-d598-43f6-8e27-c2b226cdefac tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:26.831865 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-efc28d92-d598-43f6-8e27-c2b226cdefac tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:26.832557 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-efc28d92-d598-43f6-8e27-c2b226cdefac tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:26.833027 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-efc28d92-d598-43f6-8e27-c2b226cdefac tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:26.833446 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-efc28d92-d598-43f6-8e27-c2b226cdefac tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:26.908499 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-bc922a27-9538-4997-a1f7-74ea67e6b445 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:26.908896 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-bc922a27-9538-4997-a1f7-74ea67e6b445 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: a70e0509-33cf-40a8-a0e2-a5da4317522c] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:26.915634 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-bc922a27-9538-4997-a1f7-74ea67e6b445 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:26.916365 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-bc922a27-9538-4997-a1f7-74ea67e6b445 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:26.916365 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-bc922a27-9538-4997-a1f7-74ea67e6b445 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:26.919020 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-bc922a27-9538-4997-a1f7-74ea67e6b445 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:26.919650 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-bc922a27-9538-4997-a1f7-74ea67e6b445 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:26.920527 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-bc922a27-9538-4997-a1f7-74ea67e6b445 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:27.026241 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-efc28d92-d598-43f6-8e27-c2b226cdefac tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:27.035001 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-efc28d92-d598-43f6-8e27-c2b226cdefac tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:27.036431 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-efc28d92-d598-43f6-8e27-c2b226cdefac tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:27.037630 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-efc28d92-d598-43f6-8e27-c2b226cdefac tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0" status: 200 len: 1729 microversion: 2.20 time: 0.217753 Nov 02 14:45:27.043983 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 344/705] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:45:26 2022] GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 => generated 1729 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:45:27.103087 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-bc922a27-9538-4997-a1f7-74ea67e6b445 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:27.112388 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-bc922a27-9538-4997-a1f7-74ea67e6b445 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c" status: 200 len: 1264 microversion: 2.1 time: 0.208408 Nov 02 14:45:27.113384 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 362/706] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:26 2022] GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c => generated 1264 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:45:28.064981 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-1431ce0a-8b4f-42d2-88bc-61d56afb3170 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:28.065607 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-1431ce0a-8b4f-42d2-88bc-61d56afb3170 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:28.072416 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1431ce0a-8b4f-42d2-88bc-61d56afb3170 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:28.072918 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1431ce0a-8b4f-42d2-88bc-61d56afb3170 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:28.073388 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1431ce0a-8b4f-42d2-88bc-61d56afb3170 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:28.074093 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1431ce0a-8b4f-42d2-88bc-61d56afb3170 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:28.074717 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1431ce0a-8b4f-42d2-88bc-61d56afb3170 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:28.075146 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1431ce0a-8b4f-42d2-88bc-61d56afb3170 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:28.135295 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-e2ac1c05-5c93-40f0-a91c-3e84a9c1e537 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:28.136529 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-e2ac1c05-5c93-40f0-a91c-3e84a9c1e537 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: a70e0509-33cf-40a8-a0e2-a5da4317522c] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:28.144020 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e2ac1c05-5c93-40f0-a91c-3e84a9c1e537 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:28.144507 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e2ac1c05-5c93-40f0-a91c-3e84a9c1e537 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:28.144942 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e2ac1c05-5c93-40f0-a91c-3e84a9c1e537 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:28.145700 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e2ac1c05-5c93-40f0-a91c-3e84a9c1e537 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:28.146148 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e2ac1c05-5c93-40f0-a91c-3e84a9c1e537 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:28.146730 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e2ac1c05-5c93-40f0-a91c-3e84a9c1e537 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:28.263723 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-1431ce0a-8b4f-42d2-88bc-61d56afb3170 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:28.273337 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-1431ce0a-8b4f-42d2-88bc-61d56afb3170 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:28.275202 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-1431ce0a-8b4f-42d2-88bc-61d56afb3170 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:28.276504 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-1431ce0a-8b4f-42d2-88bc-61d56afb3170 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0" status: 200 len: 1729 microversion: 2.20 time: 0.216150 Nov 02 14:45:28.277163 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 345/707] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:45:28 2022] GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 => generated 1729 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:45:28.323307 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-e2ac1c05-5c93-40f0-a91c-3e84a9c1e537 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:28.331278 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-e2ac1c05-5c93-40f0-a91c-3e84a9c1e537 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c" status: 200 len: 1264 microversion: 2.1 time: 0.199681 Nov 02 14:45:28.331850 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 363/708] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:28 2022] GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c => generated 1264 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:45:29.302396 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-40266624-5b1a-4312-b3bc-325335ecba56 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:29.303067 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-40266624-5b1a-4312-b3bc-325335ecba56 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:29.309152 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-40266624-5b1a-4312-b3bc-325335ecba56 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:29.309639 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-40266624-5b1a-4312-b3bc-325335ecba56 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:29.310085 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-40266624-5b1a-4312-b3bc-325335ecba56 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:29.311393 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-40266624-5b1a-4312-b3bc-325335ecba56 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:29.311854 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-40266624-5b1a-4312-b3bc-325335ecba56 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:29.312289 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-40266624-5b1a-4312-b3bc-325335ecba56 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:29.353849 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-9575b97b-362e-4914-aad5-fdc58e2678e1 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:29.354534 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-9575b97b-362e-4914-aad5-fdc58e2678e1 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: a70e0509-33cf-40a8-a0e2-a5da4317522c] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:29.361966 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9575b97b-362e-4914-aad5-fdc58e2678e1 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:29.362458 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9575b97b-362e-4914-aad5-fdc58e2678e1 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:29.363146 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9575b97b-362e-4914-aad5-fdc58e2678e1 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:29.363860 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9575b97b-362e-4914-aad5-fdc58e2678e1 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:29.364313 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9575b97b-362e-4914-aad5-fdc58e2678e1 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:29.364882 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9575b97b-362e-4914-aad5-fdc58e2678e1 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:29.510697 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-40266624-5b1a-4312-b3bc-325335ecba56 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:29.522582 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-40266624-5b1a-4312-b3bc-325335ecba56 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:29.524477 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-40266624-5b1a-4312-b3bc-325335ecba56 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:29.525844 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-40266624-5b1a-4312-b3bc-325335ecba56 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0" status: 200 len: 1729 microversion: 2.20 time: 0.227470 Nov 02 14:45:29.526583 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 346/709] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:45:29 2022] GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 => generated 1729 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:45:29.559350 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-9575b97b-362e-4914-aad5-fdc58e2678e1 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:29.570410 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-9575b97b-362e-4914-aad5-fdc58e2678e1 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c" status: 200 len: 1264 microversion: 2.1 time: 0.220416 Nov 02 14:45:29.586100 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 364/710] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:29 2022] GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c => generated 1264 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:45:30.551634 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-3f77b3be-4438-4d96-8818-69aa48d885fe tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:30.552291 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-3f77b3be-4438-4d96-8818-69aa48d885fe tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:30.558860 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3f77b3be-4438-4d96-8818-69aa48d885fe tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:30.559842 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3f77b3be-4438-4d96-8818-69aa48d885fe tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:30.559842 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3f77b3be-4438-4d96-8818-69aa48d885fe tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:30.560612 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3f77b3be-4438-4d96-8818-69aa48d885fe tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:30.561158 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3f77b3be-4438-4d96-8818-69aa48d885fe tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:30.561591 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3f77b3be-4438-4d96-8818-69aa48d885fe tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:30.597991 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-d433434e-5788-4b50-bd4c-e51237316b82 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:30.598715 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-d433434e-5788-4b50-bd4c-e51237316b82 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: a70e0509-33cf-40a8-a0e2-a5da4317522c] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:30.605611 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d433434e-5788-4b50-bd4c-e51237316b82 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:30.606360 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d433434e-5788-4b50-bd4c-e51237316b82 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:30.608470 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d433434e-5788-4b50-bd4c-e51237316b82 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:30.612696 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d433434e-5788-4b50-bd4c-e51237316b82 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:30.613758 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d433434e-5788-4b50-bd4c-e51237316b82 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:30.614148 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d433434e-5788-4b50-bd4c-e51237316b82 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:30.837460 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-3f77b3be-4438-4d96-8818-69aa48d885fe tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:30.837617 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-d433434e-5788-4b50-bd4c-e51237316b82 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:30.837771 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-3f77b3be-4438-4d96-8818-69aa48d885fe tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:30.837771 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-3f77b3be-4438-4d96-8818-69aa48d885fe tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:30.837771 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-3f77b3be-4438-4d96-8818-69aa48d885fe tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0" status: 200 len: 1729 microversion: 2.20 time: 0.282552 Nov 02 14:45:30.838026 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-d433434e-5788-4b50-bd4c-e51237316b82 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c" status: 200 len: 1264 microversion: 2.1 time: 0.237092 Nov 02 14:45:30.838592 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 365/711] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:30 2022] GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c => generated 1264 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:30.845372 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 347/712] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:45:30 2022] GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 => generated 1729 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:45:31.855545 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-498e8bd0-8f19-4b48-ac7c-ecddb8e447bb tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:31.856142 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-1f423a2a-e4ae-4b45-a8ee-d6b1df5c4762 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:31.856558 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-498e8bd0-8f19-4b48-ac7c-ecddb8e447bb tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: a70e0509-33cf-40a8-a0e2-a5da4317522c] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:31.856670 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-1f423a2a-e4ae-4b45-a8ee-d6b1df5c4762 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:31.863816 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-498e8bd0-8f19-4b48-ac7c-ecddb8e447bb tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:31.864040 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1f423a2a-e4ae-4b45-a8ee-d6b1df5c4762 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:31.864304 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-498e8bd0-8f19-4b48-ac7c-ecddb8e447bb tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:31.864428 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1f423a2a-e4ae-4b45-a8ee-d6b1df5c4762 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:31.864744 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-498e8bd0-8f19-4b48-ac7c-ecddb8e447bb tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:31.864873 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1f423a2a-e4ae-4b45-a8ee-d6b1df5c4762 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:31.865476 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1f423a2a-e4ae-4b45-a8ee-d6b1df5c4762 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:31.865629 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-498e8bd0-8f19-4b48-ac7c-ecddb8e447bb tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:31.865926 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1f423a2a-e4ae-4b45-a8ee-d6b1df5c4762 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:31.866091 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-498e8bd0-8f19-4b48-ac7c-ecddb8e447bb tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:31.866353 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1f423a2a-e4ae-4b45-a8ee-d6b1df5c4762 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:31.866516 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-498e8bd0-8f19-4b48-ac7c-ecddb8e447bb tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:32.107731 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-498e8bd0-8f19-4b48-ac7c-ecddb8e447bb tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:32.111963 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-1f423a2a-e4ae-4b45-a8ee-d6b1df5c4762 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:32.116362 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-498e8bd0-8f19-4b48-ac7c-ecddb8e447bb tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c" status: 200 len: 1264 microversion: 2.1 time: 0.264560 Nov 02 14:45:32.116951 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 366/713] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:31 2022] GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c => generated 1264 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:32.121442 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-1f423a2a-e4ae-4b45-a8ee-d6b1df5c4762 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:32.123226 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-1f423a2a-e4ae-4b45-a8ee-d6b1df5c4762 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:32.124538 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-1f423a2a-e4ae-4b45-a8ee-d6b1df5c4762 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0" status: 200 len: 1729 microversion: 2.20 time: 0.272703 Nov 02 14:45:32.125116 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 348/714] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:45:31 2022] GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 => generated 1729 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:45:33.139607 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-94597132-8627-4d39-a01b-0e7664408f62 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:33.140225 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-94597132-8627-4d39-a01b-0e7664408f62 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: a70e0509-33cf-40a8-a0e2-a5da4317522c] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:33.146626 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-94597132-8627-4d39-a01b-0e7664408f62 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:33.147100 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-94597132-8627-4d39-a01b-0e7664408f62 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:33.147548 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-94597132-8627-4d39-a01b-0e7664408f62 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:33.148217 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-94597132-8627-4d39-a01b-0e7664408f62 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:33.148663 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-94597132-8627-4d39-a01b-0e7664408f62 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:33.149108 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-94597132-8627-4d39-a01b-0e7664408f62 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:33.155314 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-e7959cd6-72a7-468e-af79-a8a33c9bd164 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:33.155853 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-e7959cd6-72a7-468e-af79-a8a33c9bd164 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:33.162320 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e7959cd6-72a7-468e-af79-a8a33c9bd164 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:33.162805 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e7959cd6-72a7-468e-af79-a8a33c9bd164 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:33.163246 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e7959cd6-72a7-468e-af79-a8a33c9bd164 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:33.163944 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e7959cd6-72a7-468e-af79-a8a33c9bd164 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:33.164395 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e7959cd6-72a7-468e-af79-a8a33c9bd164 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:33.164829 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e7959cd6-72a7-468e-af79-a8a33c9bd164 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:33.335559 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-94597132-8627-4d39-a01b-0e7664408f62 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:33.344261 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-94597132-8627-4d39-a01b-0e7664408f62 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c" status: 200 len: 1264 microversion: 2.1 time: 0.208450 Nov 02 14:45:33.344990 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 367/715] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:33 2022] GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c => generated 1264 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:33.359679 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-e7959cd6-72a7-468e-af79-a8a33c9bd164 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:33.368071 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-e7959cd6-72a7-468e-af79-a8a33c9bd164 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:33.369531 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-e7959cd6-72a7-468e-af79-a8a33c9bd164 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:33.370679 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-e7959cd6-72a7-468e-af79-a8a33c9bd164 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0" status: 200 len: 1729 microversion: 2.20 time: 0.220048 Nov 02 14:45:33.371235 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 349/716] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:45:33 2022] GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 => generated 1729 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:45:34.367988 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-c968ce01-8c49-430a-bede-9d4c2fe37a8e tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:34.368599 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-c968ce01-8c49-430a-bede-9d4c2fe37a8e tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: a70e0509-33cf-40a8-a0e2-a5da4317522c] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:34.375183 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c968ce01-8c49-430a-bede-9d4c2fe37a8e tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:34.375663 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c968ce01-8c49-430a-bede-9d4c2fe37a8e tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:34.376098 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c968ce01-8c49-430a-bede-9d4c2fe37a8e tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:34.376786 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c968ce01-8c49-430a-bede-9d4c2fe37a8e tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:34.377261 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c968ce01-8c49-430a-bede-9d4c2fe37a8e tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:34.380858 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c968ce01-8c49-430a-bede-9d4c2fe37a8e tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:34.395237 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-ec978ccb-c761-4de5-95fa-6baca5c19aec tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:34.395868 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-ec978ccb-c761-4de5-95fa-6baca5c19aec tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:34.398161 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:45:34.402797 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ec978ccb-c761-4de5-95fa-6baca5c19aec tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:34.403283 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ec978ccb-c761-4de5-95fa-6baca5c19aec tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:34.403722 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ec978ccb-c761-4de5-95fa-6baca5c19aec tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:34.405078 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ec978ccb-c761-4de5-95fa-6baca5c19aec tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:34.405537 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ec978ccb-c761-4de5-95fa-6baca5c19aec tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:34.405964 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ec978ccb-c761-4de5-95fa-6baca5c19aec tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:34.585808 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-c968ce01-8c49-430a-bede-9d4c2fe37a8e tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:34.589134 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-ec978ccb-c761-4de5-95fa-6baca5c19aec tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:34.597098 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-c968ce01-8c49-430a-bede-9d4c2fe37a8e tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c" status: 200 len: 1451 microversion: 2.1 time: 0.232777 Nov 02 14:45:34.597836 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 368/717] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:34 2022] GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c => generated 1451 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:34.600375 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-ec978ccb-c761-4de5-95fa-6baca5c19aec tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:34.601946 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-ec978ccb-c761-4de5-95fa-6baca5c19aec tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:34.603363 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-ec978ccb-c761-4de5-95fa-6baca5c19aec tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0" status: 200 len: 1729 microversion: 2.20 time: 0.211935 Nov 02 14:45:34.603911 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 350/718] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:45:34 2022] GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 => generated 1729 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:45:34.620319 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-a3ae7b00-22e3-41ff-982c-0bab68e6330c tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:34.620849 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-a3ae7b00-22e3-41ff-982c-0bab68e6330c tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: a70e0509-33cf-40a8-a0e2-a5da4317522c] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:34.627225 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a3ae7b00-22e3-41ff-982c-0bab68e6330c tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:34.627721 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a3ae7b00-22e3-41ff-982c-0bab68e6330c tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:34.628153 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a3ae7b00-22e3-41ff-982c-0bab68e6330c tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:34.628853 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a3ae7b00-22e3-41ff-982c-0bab68e6330c tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:34.629330 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a3ae7b00-22e3-41ff-982c-0bab68e6330c tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:34.629756 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a3ae7b00-22e3-41ff-982c-0bab68e6330c tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:34.762599 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-a3ae7b00-22e3-41ff-982c-0bab68e6330c tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:34.770967 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-a3ae7b00-22e3-41ff-982c-0bab68e6330c tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c" status: 200 len: 1451 microversion: 2.1 time: 0.154477 Nov 02 14:45:34.775422 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 369/719] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:34 2022] GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:35.629377 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-73230515-b543-43b1-9392-8a26cea38670 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:35.630003 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-73230515-b543-43b1-9392-8a26cea38670 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:35.636364 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-73230515-b543-43b1-9392-8a26cea38670 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:35.636846 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-73230515-b543-43b1-9392-8a26cea38670 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:35.637317 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-73230515-b543-43b1-9392-8a26cea38670 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:35.638011 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-73230515-b543-43b1-9392-8a26cea38670 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:35.638494 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-73230515-b543-43b1-9392-8a26cea38670 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:35.639327 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-73230515-b543-43b1-9392-8a26cea38670 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:35.783862 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-73230515-b543-43b1-9392-8a26cea38670 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:35.792207 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-73230515-b543-43b1-9392-8a26cea38670 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:35.795605 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-73230515-b543-43b1-9392-8a26cea38670 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:35.795605 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-73230515-b543-43b1-9392-8a26cea38670 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0" status: 200 len: 1729 microversion: 2.20 time: 0.169341 Nov 02 14:45:35.796096 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 351/720] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:45:35 2022] GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:45:36.814092 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [req-dc3edcd3-b607-485f-ace6-356546d7dc92 req-ba585909-4cad-48dd-9341-1e3c64dce8ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a70e0509-33cf-40a8-a0e2-a5da4317522c", "tag": "31597016-abf2-4436-a570-4e0d25351888"}]} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:45:36.822173 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-1e87e798-e843-4c65-a398-ea3fde5c4ca7 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:36.822779 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-1e87e798-e843-4c65-a398-ea3fde5c4ca7 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:36.828418 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-dc3edcd3-b607-485f-ace6-356546d7dc92 req-ba585909-4cad-48dd-9341-1e3c64dce8ab service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:36.829013 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-dc3edcd3-b607-485f-ace6-356546d7dc92 req-ba585909-4cad-48dd-9341-1e3c64dce8ab service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:36.829528 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-dc3edcd3-b607-485f-ace6-356546d7dc92 req-ba585909-4cad-48dd-9341-1e3c64dce8ab service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:36.830160 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1e87e798-e843-4c65-a398-ea3fde5c4ca7 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:36.830646 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1e87e798-e843-4c65-a398-ea3fde5c4ca7 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:36.831294 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1e87e798-e843-4c65-a398-ea3fde5c4ca7 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:36.831997 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1e87e798-e843-4c65-a398-ea3fde5c4ca7 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:36.832444 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1e87e798-e843-4c65-a398-ea3fde5c4ca7 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:36.832864 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1e87e798-e843-4c65-a398-ea3fde5c4ca7 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:36.844688 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.compute.server_external_events [req-dc3edcd3-b607-485f-ace6-356546d7dc92 req-ba585909-4cad-48dd-9341-1e3c64dce8ab service nova] Creating event network-changed:31597016-abf2-4436-a570-4e0d25351888 for instance a70e0509-33cf-40a8-a0e2-a5da4317522c on hv-cinder-86236 Nov 02 14:45:36.849975 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [req-dc3edcd3-b607-485f-ace6-356546d7dc92 req-ba585909-4cad-48dd-9341-1e3c64dce8ab service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041342 Nov 02 14:45:36.850802 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 370/721] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:45:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:45:37.034090 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-1e87e798-e843-4c65-a398-ea3fde5c4ca7 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:37.043456 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-1e87e798-e843-4c65-a398-ea3fde5c4ca7 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:37.045089 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-1e87e798-e843-4c65-a398-ea3fde5c4ca7 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:37.046423 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-1e87e798-e843-4c65-a398-ea3fde5c4ca7 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0" status: 200 len: 1729 microversion: 2.20 time: 0.228743 Nov 02 14:45:37.053514 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 352/722] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:45:36 2022] GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 => generated 1729 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:45:38.072956 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-ec9a7986-008e-4a0b-9894-b1cb61a328d9 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:38.073703 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-ec9a7986-008e-4a0b-9894-b1cb61a328d9 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:38.075632 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_api:SELECT=64 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:45:38.081286 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ec9a7986-008e-4a0b-9894-b1cb61a328d9 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:38.081760 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ec9a7986-008e-4a0b-9894-b1cb61a328d9 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:38.082191 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ec9a7986-008e-4a0b-9894-b1cb61a328d9 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:38.082872 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ec9a7986-008e-4a0b-9894-b1cb61a328d9 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:38.083320 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ec9a7986-008e-4a0b-9894-b1cb61a328d9 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:38.083739 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ec9a7986-008e-4a0b-9894-b1cb61a328d9 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:38.218488 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-ec9a7986-008e-4a0b-9894-b1cb61a328d9 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:38.226566 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-ec9a7986-008e-4a0b-9894-b1cb61a328d9 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:38.227927 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-ec9a7986-008e-4a0b-9894-b1cb61a328d9 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:38.229102 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-ec9a7986-008e-4a0b-9894-b1cb61a328d9 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0" status: 200 len: 1729 microversion: 2.20 time: 0.160895 Nov 02 14:45:38.229659 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 371/723] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:45:38 2022] GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:45:38.577819 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [req-98ddfb96-d873-4e36-8bbd-c91148925452 req-c6965608-2c26-4ba4-af57-c551f0a4ce3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea6a4066-de22-411b-9e4b-1531cb199bc0", "name": "network-vif-plugged", "status": "completed", "tag": "bdb24aef-c8c8-4727-9d59-dbef941eb4f8"}]} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:45:38.587652 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-98ddfb96-d873-4e36-8bbd-c91148925452 req-c6965608-2c26-4ba4-af57-c551f0a4ce3e service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:38.588125 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-98ddfb96-d873-4e36-8bbd-c91148925452 req-c6965608-2c26-4ba4-af57-c551f0a4ce3e service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:38.588555 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-98ddfb96-d873-4e36-8bbd-c91148925452 req-c6965608-2c26-4ba4-af57-c551f0a4ce3e service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:38.600287 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.compute.server_external_events [req-98ddfb96-d873-4e36-8bbd-c91148925452 req-c6965608-2c26-4ba4-af57-c551f0a4ce3e service nova] Creating event network-vif-plugged:bdb24aef-c8c8-4727-9d59-dbef941eb4f8 for instance ea6a4066-de22-411b-9e4b-1531cb199bc0 on hv-cinder-86236 Nov 02 14:45:38.605614 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [req-98ddfb96-d873-4e36-8bbd-c91148925452 req-c6965608-2c26-4ba4-af57-c551f0a4ce3e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031688 Nov 02 14:45:38.609228 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 353/724] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:45:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:45:39.254362 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-6f990c7e-502c-4cb8-a973-29ddc316d4ce tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:39.254960 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-6f990c7e-502c-4cb8-a973-29ddc316d4ce tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:39.261788 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6f990c7e-502c-4cb8-a973-29ddc316d4ce tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:39.262271 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6f990c7e-502c-4cb8-a973-29ddc316d4ce tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:39.262702 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6f990c7e-502c-4cb8-a973-29ddc316d4ce tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:39.263399 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6f990c7e-502c-4cb8-a973-29ddc316d4ce tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:39.263840 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6f990c7e-502c-4cb8-a973-29ddc316d4ce tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:39.264260 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6f990c7e-502c-4cb8-a973-29ddc316d4ce tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:39.399164 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-6f990c7e-502c-4cb8-a973-29ddc316d4ce tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:39.408237 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-6f990c7e-502c-4cb8-a973-29ddc316d4ce tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:39.409738 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-6f990c7e-502c-4cb8-a973-29ddc316d4ce tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:39.410911 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-6f990c7e-502c-4cb8-a973-29ddc316d4ce tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0" status: 200 len: 1729 microversion: 2.20 time: 0.160421 Nov 02 14:45:39.411515 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 372/725] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:45:39 2022] GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:45:40.438164 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-2fbd9d3a-6c88-43e5-94cc-73d05affc178 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:40.438823 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-2fbd9d3a-6c88-43e5-94cc-73d05affc178 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:40.444840 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2fbd9d3a-6c88-43e5-94cc-73d05affc178 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:40.445356 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2fbd9d3a-6c88-43e5-94cc-73d05affc178 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:40.445789 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2fbd9d3a-6c88-43e5-94cc-73d05affc178 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:40.446477 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2fbd9d3a-6c88-43e5-94cc-73d05affc178 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:40.446931 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2fbd9d3a-6c88-43e5-94cc-73d05affc178 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:40.447349 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2fbd9d3a-6c88-43e5-94cc-73d05affc178 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:40.583885 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-2fbd9d3a-6c88-43e5-94cc-73d05affc178 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:40.592909 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-2fbd9d3a-6c88-43e5-94cc-73d05affc178 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:40.594389 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-2fbd9d3a-6c88-43e5-94cc-73d05affc178 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:40.595728 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-2fbd9d3a-6c88-43e5-94cc-73d05affc178 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0" status: 200 len: 1729 microversion: 2.20 time: 0.162375 Nov 02 14:45:40.596274 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 354/726] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:45:40 2022] GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:45:41.621128 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-dc4de3fc-b7f5-49a1-b3f9-1eacf9a310e8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:41.621744 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-dc4de3fc-b7f5-49a1-b3f9-1eacf9a310e8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:41.628764 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-dc4de3fc-b7f5-49a1-b3f9-1eacf9a310e8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:41.629268 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-dc4de3fc-b7f5-49a1-b3f9-1eacf9a310e8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:41.629704 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-dc4de3fc-b7f5-49a1-b3f9-1eacf9a310e8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:41.630395 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-dc4de3fc-b7f5-49a1-b3f9-1eacf9a310e8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:41.630845 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-dc4de3fc-b7f5-49a1-b3f9-1eacf9a310e8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:41.631268 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-dc4de3fc-b7f5-49a1-b3f9-1eacf9a310e8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:41.764371 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-dc4de3fc-b7f5-49a1-b3f9-1eacf9a310e8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:41.772388 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-dc4de3fc-b7f5-49a1-b3f9-1eacf9a310e8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:41.773849 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-dc4de3fc-b7f5-49a1-b3f9-1eacf9a310e8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:41.775049 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-dc4de3fc-b7f5-49a1-b3f9-1eacf9a310e8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0" status: 200 len: 1729 microversion: 2.20 time: 0.157861 Nov 02 14:45:41.775558 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 373/727] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:45:41 2022] GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:45:42.801337 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-2619ce67-f07e-438a-a979-abf3a67daea8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:42.801935 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-2619ce67-f07e-438a-a979-abf3a67daea8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:42.808415 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2619ce67-f07e-438a-a979-abf3a67daea8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:42.808897 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2619ce67-f07e-438a-a979-abf3a67daea8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:42.809358 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2619ce67-f07e-438a-a979-abf3a67daea8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:42.810115 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2619ce67-f07e-438a-a979-abf3a67daea8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:42.811107 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2619ce67-f07e-438a-a979-abf3a67daea8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:42.811530 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2619ce67-f07e-438a-a979-abf3a67daea8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:42.947667 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-2619ce67-f07e-438a-a979-abf3a67daea8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:42.955956 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-2619ce67-f07e-438a-a979-abf3a67daea8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:42.957436 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-2619ce67-f07e-438a-a979-abf3a67daea8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:42.958599 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-2619ce67-f07e-438a-a979-abf3a67daea8 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0" status: 200 len: 1716 microversion: 2.20 time: 0.161186 Nov 02 14:45:42.959158 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 355/728] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:45:42 2022] GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 => generated 1716 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:45:55.904619 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-874c2bcd-90e6-4d72-9f6f-10e1e5cc9147 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:55.905227 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-874c2bcd-90e6-4d72-9f6f-10e1e5cc9147 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:55.907562 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_api:SELECT=5 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:45:55.908204 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell1:SELECT=97 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:45:55.913063 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-874c2bcd-90e6-4d72-9f6f-10e1e5cc9147 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:55.913561 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-874c2bcd-90e6-4d72-9f6f-10e1e5cc9147 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:55.920062 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-874c2bcd-90e6-4d72-9f6f-10e1e5cc9147 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:55.920062 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-874c2bcd-90e6-4d72-9f6f-10e1e5cc9147 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:55.920062 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-874c2bcd-90e6-4d72-9f6f-10e1e5cc9147 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:55.920062 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-874c2bcd-90e6-4d72-9f6f-10e1e5cc9147 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:55.940096 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-874c2bcd-90e6-4d72-9f6f-10e1e5cc9147 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290/ips" status: 200 len: 146 microversion: 2.1 time: 0.039294 Nov 02 14:45:55.943266 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 374/729] 10.222.0.30 () {58 vars in 1248 bytes} [Wed Nov 2 14:45:55 2022] GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:45:59.074207 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-15969557-d186-4c1f-b92e-516556ff514d tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eac7df99-29d5-4a62-a7a7-2e6f6ddb2c99"}} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:45:59.077268 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-15969557-d186-4c1f-b92e-516556ff514d tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:59.079847 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_api:SELECT=11 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:45:59.080517 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell1:SELECT=97 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:45:59.085273 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-15969557-d186-4c1f-b92e-516556ff514d tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:59.085759 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-15969557-d186-4c1f-b92e-516556ff514d tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:59.086199 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-15969557-d186-4c1f-b92e-516556ff514d tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:59.086910 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-15969557-d186-4c1f-b92e-516556ff514d tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:59.087349 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-15969557-d186-4c1f-b92e-516556ff514d tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:59.087774 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-15969557-d186-4c1f-b92e-516556ff514d tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:59.908977 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-15969557-d186-4c1f-b92e-516556ff514d tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "POST /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.838428 Nov 02 14:45:59.909618 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 356/730] 10.222.0.30 () {60 vars in 1323 bytes} [Wed Nov 2 14:45:59 2022] POST /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290/os-volume_attachments => generated 194 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:46:07.445849 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-2fcef8e3-9cee-4906-a65b-8c76a2e70e78 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:46:07.448223 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_api:SELECT=2 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:46:07.453318 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2fcef8e3-9cee-4906-a65b-8c76a2e70e78 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:07.453794 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2fcef8e3-9cee-4906-a65b-8c76a2e70e78 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:07.454239 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2fcef8e3-9cee-4906-a65b-8c76a2e70e78 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:07.514743 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-2fcef8e3-9cee-4906-a65b-8c76a2e70e78 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Going to try to stop instance {{(pid=119659) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 14:46:07.683989 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-2fcef8e3-9cee-4906-a65b-8c76a2e70e78 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "POST /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290/action" status: 202 len: 0 microversion: 2.1 time: 0.242036 Nov 02 14:46:07.685123 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 375/731] 10.222.0.30 () {60 vars in 1278 bytes} [Wed Nov 2 14:46:07 2022] POST /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:46:07.694339 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-b78a79be-0bb2-4db7-a3a9-362075902f70 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:07.695162 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-b78a79be-0bb2-4db7-a3a9-362075902f70 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:07.703060 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b78a79be-0bb2-4db7-a3a9-362075902f70 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:07.703551 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b78a79be-0bb2-4db7-a3a9-362075902f70 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:07.703994 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b78a79be-0bb2-4db7-a3a9-362075902f70 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:07.704695 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b78a79be-0bb2-4db7-a3a9-362075902f70 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:07.705179 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b78a79be-0bb2-4db7-a3a9-362075902f70 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:07.705609 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b78a79be-0bb2-4db7-a3a9-362075902f70 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:07.836559 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-b78a79be-0bb2-4db7-a3a9-362075902f70 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:07.844954 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-b78a79be-0bb2-4db7-a3a9-362075902f70 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290" status: 200 len: 1723 microversion: 2.1 time: 0.155324 Nov 02 14:46:07.845542 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 357/732] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:46:07 2022] GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:46:08.868980 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-ce164671-2c66-4e85-a329-d7c0aefd6877 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:08.869695 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-ce164671-2c66-4e85-a329-d7c0aefd6877 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:08.875869 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ce164671-2c66-4e85-a329-d7c0aefd6877 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:08.876350 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ce164671-2c66-4e85-a329-d7c0aefd6877 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:08.876784 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ce164671-2c66-4e85-a329-d7c0aefd6877 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:08.877533 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ce164671-2c66-4e85-a329-d7c0aefd6877 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:08.877982 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ce164671-2c66-4e85-a329-d7c0aefd6877 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:08.878453 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ce164671-2c66-4e85-a329-d7c0aefd6877 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:09.015153 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-ce164671-2c66-4e85-a329-d7c0aefd6877 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:09.023312 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-ce164671-2c66-4e85-a329-d7c0aefd6877 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290" status: 200 len: 1723 microversion: 2.1 time: 0.159271 Nov 02 14:46:09.023882 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 376/733] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:46:08 2022] GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:46:10.046486 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-fb5d7b62-0fbb-4004-beb4-6019777b40b1 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:10.047099 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-fb5d7b62-0fbb-4004-beb4-6019777b40b1 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:10.053669 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-fb5d7b62-0fbb-4004-beb4-6019777b40b1 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:10.054149 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-fb5d7b62-0fbb-4004-beb4-6019777b40b1 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:10.054588 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-fb5d7b62-0fbb-4004-beb4-6019777b40b1 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:10.055276 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-fb5d7b62-0fbb-4004-beb4-6019777b40b1 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:10.055749 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-fb5d7b62-0fbb-4004-beb4-6019777b40b1 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:10.056176 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-fb5d7b62-0fbb-4004-beb4-6019777b40b1 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:10.187747 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-fb5d7b62-0fbb-4004-beb4-6019777b40b1 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:10.198299 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-fb5d7b62-0fbb-4004-beb4-6019777b40b1 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290" status: 200 len: 1723 microversion: 2.1 time: 0.155799 Nov 02 14:46:10.198868 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 358/734] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:46:10 2022] GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:46:11.221747 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-3b35053a-71dd-4e43-aef9-b6e1885c0432 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:11.222301 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-3b35053a-71dd-4e43-aef9-b6e1885c0432 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:11.228740 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3b35053a-71dd-4e43-aef9-b6e1885c0432 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:11.229256 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3b35053a-71dd-4e43-aef9-b6e1885c0432 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:11.229694 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3b35053a-71dd-4e43-aef9-b6e1885c0432 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:11.230383 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3b35053a-71dd-4e43-aef9-b6e1885c0432 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:11.230830 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3b35053a-71dd-4e43-aef9-b6e1885c0432 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:11.231806 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3b35053a-71dd-4e43-aef9-b6e1885c0432 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:11.364477 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-3b35053a-71dd-4e43-aef9-b6e1885c0432 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:11.374481 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-3b35053a-71dd-4e43-aef9-b6e1885c0432 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290" status: 200 len: 1723 microversion: 2.1 time: 0.156768 Nov 02 14:46:11.375229 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 377/735] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:46:11 2022] GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:46:12.400491 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-ae17235a-c678-42c2-bfcf-4bb2c16c9a09 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:12.401131 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-ae17235a-c678-42c2-bfcf-4bb2c16c9a09 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:12.407740 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ae17235a-c678-42c2-bfcf-4bb2c16c9a09 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:12.408226 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ae17235a-c678-42c2-bfcf-4bb2c16c9a09 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:12.408658 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ae17235a-c678-42c2-bfcf-4bb2c16c9a09 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:12.409369 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ae17235a-c678-42c2-bfcf-4bb2c16c9a09 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:12.409816 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ae17235a-c678-42c2-bfcf-4bb2c16c9a09 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:12.410240 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ae17235a-c678-42c2-bfcf-4bb2c16c9a09 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:12.542618 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-ae17235a-c678-42c2-bfcf-4bb2c16c9a09 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:12.551501 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-ae17235a-c678-42c2-bfcf-4bb2c16c9a09 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290" status: 200 len: 1723 microversion: 2.1 time: 0.154969 Nov 02 14:46:12.552062 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 359/736] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:46:12 2022] GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:46:13.576254 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-2ce6c484-414f-4f36-aa4f-52d142474915 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:13.576845 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-2ce6c484-414f-4f36-aa4f-52d142474915 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:13.583207 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2ce6c484-414f-4f36-aa4f-52d142474915 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:13.583688 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2ce6c484-414f-4f36-aa4f-52d142474915 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:13.584126 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2ce6c484-414f-4f36-aa4f-52d142474915 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:13.584849 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2ce6c484-414f-4f36-aa4f-52d142474915 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:13.585338 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2ce6c484-414f-4f36-aa4f-52d142474915 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:13.585761 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2ce6c484-414f-4f36-aa4f-52d142474915 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:13.714621 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-2ce6c484-414f-4f36-aa4f-52d142474915 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:13.722947 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-2ce6c484-414f-4f36-aa4f-52d142474915 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290" status: 200 len: 1723 microversion: 2.1 time: 0.151025 Nov 02 14:46:13.723518 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 378/737] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:46:13 2022] GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:46:14.746266 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-23b02d12-213a-459d-85b9-c6f281110d34 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:14.747596 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-23b02d12-213a-459d-85b9-c6f281110d34 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:14.754089 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-23b02d12-213a-459d-85b9-c6f281110d34 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:14.754578 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-23b02d12-213a-459d-85b9-c6f281110d34 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:14.755017 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-23b02d12-213a-459d-85b9-c6f281110d34 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:14.755711 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-23b02d12-213a-459d-85b9-c6f281110d34 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:14.756165 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-23b02d12-213a-459d-85b9-c6f281110d34 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:14.756622 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-23b02d12-213a-459d-85b9-c6f281110d34 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:14.887690 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-23b02d12-213a-459d-85b9-c6f281110d34 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:14.896669 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-23b02d12-213a-459d-85b9-c6f281110d34 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290" status: 200 len: 1723 microversion: 2.1 time: 0.154168 Nov 02 14:46:14.897207 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 360/738] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:46:14 2022] GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:46:15.721369 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-9ad9477d-8113-49a7-908c-d43571d28069 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:15.723576 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-9ad9477d-8113-49a7-908c-d43571d28069 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:15.729880 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9ad9477d-8113-49a7-908c-d43571d28069 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:15.730354 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9ad9477d-8113-49a7-908c-d43571d28069 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:15.730782 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9ad9477d-8113-49a7-908c-d43571d28069 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:15.732062 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9ad9477d-8113-49a7-908c-d43571d28069 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:15.732505 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9ad9477d-8113-49a7-908c-d43571d28069 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:15.732925 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9ad9477d-8113-49a7-908c-d43571d28069 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:15.762936 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-9ad9477d-8113-49a7-908c-d43571d28069 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045568 Nov 02 14:46:15.763501 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 379/739] 10.222.0.30 () {60 vars in 1343 bytes} [Wed Nov 2 14:46:15 2022] GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:46:15.827363 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-521c4e02-60bc-484b-a40e-fd2b459bef30 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:15.829170 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-521c4e02-60bc-484b-a40e-fd2b459bef30 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:15.834338 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-521c4e02-60bc-484b-a40e-fd2b459bef30 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:15.834828 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-521c4e02-60bc-484b-a40e-fd2b459bef30 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:15.839483 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-521c4e02-60bc-484b-a40e-fd2b459bef30 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:15.839483 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-521c4e02-60bc-484b-a40e-fd2b459bef30 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:15.839483 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-521c4e02-60bc-484b-a40e-fd2b459bef30 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:15.839483 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-521c4e02-60bc-484b-a40e-fd2b459bef30 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:15.864575 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-521c4e02-60bc-484b-a40e-fd2b459bef30 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Going to try to terminate instance {{(pid=119658) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:46:15.920870 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-f71adab0-8af3-46b3-8562-3b9eae13ab4f tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:15.921492 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-f71adab0-8af3-46b3-8562-3b9eae13ab4f tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:15.927383 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f71adab0-8af3-46b3-8562-3b9eae13ab4f tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:15.927852 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f71adab0-8af3-46b3-8562-3b9eae13ab4f tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:15.928285 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f71adab0-8af3-46b3-8562-3b9eae13ab4f tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:15.928964 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f71adab0-8af3-46b3-8562-3b9eae13ab4f tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:15.929430 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f71adab0-8af3-46b3-8562-3b9eae13ab4f tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:15.929846 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f71adab0-8af3-46b3-8562-3b9eae13ab4f tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:16.056935 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-f71adab0-8af3-46b3-8562-3b9eae13ab4f tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:16.066065 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-f71adab0-8af3-46b3-8562-3b9eae13ab4f tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290" status: 200 len: 1723 microversion: 2.1 time: 0.149770 Nov 02 14:46:16.066671 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 380/740] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:46:15 2022] GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:46:16.149601 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-521c4e02-60bc-484b-a40e-fd2b459bef30 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0" status: 204 len: 0 microversion: 2.20 time: 0.325886 Nov 02 14:46:16.150311 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 361/741] 10.222.0.30 () {60 vars in 1280 bytes} [Wed Nov 2 14:46:15 2022] DELETE /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 14:46:16.158773 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-322315a6-9b22-49bb-bf6d-4705ed7e3e12 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:16.159414 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-322315a6-9b22-49bb-bf6d-4705ed7e3e12 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:16.165410 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-322315a6-9b22-49bb-bf6d-4705ed7e3e12 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:16.165879 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-322315a6-9b22-49bb-bf6d-4705ed7e3e12 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:16.166857 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-322315a6-9b22-49bb-bf6d-4705ed7e3e12 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:16.167560 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-322315a6-9b22-49bb-bf6d-4705ed7e3e12 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:16.168210 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-322315a6-9b22-49bb-bf6d-4705ed7e3e12 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:16.169144 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-322315a6-9b22-49bb-bf6d-4705ed7e3e12 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:16.299048 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-322315a6-9b22-49bb-bf6d-4705ed7e3e12 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:16.306929 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-322315a6-9b22-49bb-bf6d-4705ed7e3e12 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:16.308339 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-322315a6-9b22-49bb-bf6d-4705ed7e3e12 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:16.309929 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-322315a6-9b22-49bb-bf6d-4705ed7e3e12 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0" status: 200 len: 1722 microversion: 2.20 time: 0.154638 Nov 02 14:46:16.310603 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 381/742] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:46:16 2022] GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:46:17.090100 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-cc3cce5c-9c2a-475d-b5e3-0f2c523c0a2a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:17.091455 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-cc3cce5c-9c2a-475d-b5e3-0f2c523c0a2a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:17.100768 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-cc3cce5c-9c2a-475d-b5e3-0f2c523c0a2a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:17.101287 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-cc3cce5c-9c2a-475d-b5e3-0f2c523c0a2a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:17.101723 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-cc3cce5c-9c2a-475d-b5e3-0f2c523c0a2a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:17.102425 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-cc3cce5c-9c2a-475d-b5e3-0f2c523c0a2a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:17.102873 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-cc3cce5c-9c2a-475d-b5e3-0f2c523c0a2a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:17.103291 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-cc3cce5c-9c2a-475d-b5e3-0f2c523c0a2a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:17.240065 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-cc3cce5c-9c2a-475d-b5e3-0f2c523c0a2a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:17.250002 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-cc3cce5c-9c2a-475d-b5e3-0f2c523c0a2a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290" status: 200 len: 1723 microversion: 2.1 time: 0.164120 Nov 02 14:46:17.250609 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 362/743] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:46:17 2022] GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:46:17.335897 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-6b205065-1d83-4970-80e3-214a7a31c622 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:17.336499 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-6b205065-1d83-4970-80e3-214a7a31c622 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:17.344107 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6b205065-1d83-4970-80e3-214a7a31c622 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:17.344585 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6b205065-1d83-4970-80e3-214a7a31c622 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:17.345026 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6b205065-1d83-4970-80e3-214a7a31c622 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:17.345734 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6b205065-1d83-4970-80e3-214a7a31c622 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:17.346175 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6b205065-1d83-4970-80e3-214a7a31c622 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:17.346595 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6b205065-1d83-4970-80e3-214a7a31c622 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:17.486082 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-6b205065-1d83-4970-80e3-214a7a31c622 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:17.495746 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-6b205065-1d83-4970-80e3-214a7a31c622 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:17.497325 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-6b205065-1d83-4970-80e3-214a7a31c622 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:17.498598 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-6b205065-1d83-4970-80e3-214a7a31c622 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0" status: 200 len: 1722 microversion: 2.20 time: 0.166637 Nov 02 14:46:17.499152 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 382/744] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:46:17 2022] GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:46:18.275394 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-be9d4b73-ffff-4014-a97f-2c501ac034f4 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:18.276184 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-be9d4b73-ffff-4014-a97f-2c501ac034f4 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:18.283339 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-be9d4b73-ffff-4014-a97f-2c501ac034f4 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:18.283834 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-be9d4b73-ffff-4014-a97f-2c501ac034f4 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:18.284282 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-be9d4b73-ffff-4014-a97f-2c501ac034f4 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:18.284994 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-be9d4b73-ffff-4014-a97f-2c501ac034f4 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:18.285475 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-be9d4b73-ffff-4014-a97f-2c501ac034f4 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:18.285899 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-be9d4b73-ffff-4014-a97f-2c501ac034f4 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:18.527703 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-84697bfa-9be8-40d1-b810-53bb1dd9ef6a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:18.529302 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-84697bfa-9be8-40d1-b810-53bb1dd9ef6a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:18.537624 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-84697bfa-9be8-40d1-b810-53bb1dd9ef6a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:18.538288 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-84697bfa-9be8-40d1-b810-53bb1dd9ef6a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:18.538814 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-84697bfa-9be8-40d1-b810-53bb1dd9ef6a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:18.539647 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-84697bfa-9be8-40d1-b810-53bb1dd9ef6a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:18.540220 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-84697bfa-9be8-40d1-b810-53bb1dd9ef6a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:18.540783 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-84697bfa-9be8-40d1-b810-53bb1dd9ef6a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:18.670852 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-84697bfa-9be8-40d1-b810-53bb1dd9ef6a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:18.681948 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-84697bfa-9be8-40d1-b810-53bb1dd9ef6a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:18.683365 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-84697bfa-9be8-40d1-b810-53bb1dd9ef6a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb0b112497dc4b64a9ea2f09f808646d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd67ec4f08d4d548af5b5ccee50407c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:18.684800 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-84697bfa-9be8-40d1-b810-53bb1dd9ef6a tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0" status: 200 len: 1656 microversion: 2.20 time: 0.161811 Nov 02 14:46:18.685578 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 383/745] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:46:18 2022] GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 => generated 1656 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:46:18.796452 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-be9d4b73-ffff-4014-a97f-2c501ac034f4 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:18.804723 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-be9d4b73-ffff-4014-a97f-2c501ac034f4 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290" status: 200 len: 1723 microversion: 2.1 time: 0.533429 Nov 02 14:46:18.805339 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 363/746] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:46:18 2022] GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290 => generated 1723 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:46:18.918301 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [req-12be7ef8-e789-4198-a5f7-49ba9ada54d2 req-c6e1c9aa-f12e-4672-8c39-56e0b98469f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea6a4066-de22-411b-9e4b-1531cb199bc0", "name": "network-vif-deleted", "tag": "bdb24aef-c8c8-4727-9d59-dbef941eb4f8"}]} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:46:18.927969 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-12be7ef8-e789-4198-a5f7-49ba9ada54d2 req-c6e1c9aa-f12e-4672-8c39-56e0b98469f1 service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:18.928445 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-12be7ef8-e789-4198-a5f7-49ba9ada54d2 req-c6e1c9aa-f12e-4672-8c39-56e0b98469f1 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:18.928880 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-12be7ef8-e789-4198-a5f7-49ba9ada54d2 req-c6e1c9aa-f12e-4672-8c39-56e0b98469f1 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:18.940634 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.compute.server_external_events [req-12be7ef8-e789-4198-a5f7-49ba9ada54d2 req-c6e1c9aa-f12e-4672-8c39-56e0b98469f1 service nova] Creating event network-vif-deleted:bdb24aef-c8c8-4727-9d59-dbef941eb4f8 for instance ea6a4066-de22-411b-9e4b-1531cb199bc0 on hv-cinder-86236 Nov 02 14:46:18.946216 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [req-12be7ef8-e789-4198-a5f7-49ba9ada54d2 req-c6e1c9aa-f12e-4672-8c39-56e0b98469f1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031519 Nov 02 14:46:18.947420 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 384/747] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:46:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:46:19.710541 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-7e82874a-5ed9-430f-8ca8-3db1e93f74a3 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:19.711445 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-7e82874a-5ed9-430f-8ca8-3db1e93f74a3 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:19.718855 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7e82874a-5ed9-430f-8ca8-3db1e93f74a3 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:19.719346 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7e82874a-5ed9-430f-8ca8-3db1e93f74a3 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:19.719786 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7e82874a-5ed9-430f-8ca8-3db1e93f74a3 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:19.720498 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7e82874a-5ed9-430f-8ca8-3db1e93f74a3 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:19.720954 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7e82874a-5ed9-430f-8ca8-3db1e93f74a3 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:19.721571 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7e82874a-5ed9-430f-8ca8-3db1e93f74a3 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:19.737048 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.wsgi [None req-7e82874a-5ed9-430f-8ca8-3db1e93f74a3 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] HTTP exception thrown: Instance ea6a4066-de22-411b-9e4b-1531cb199bc0 could not be found. Nov 02 14:46:19.738748 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-7e82874a-5ed9-430f-8ca8-3db1e93f74a3 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Request method failure captured: Nov 02 14:46:19.738748 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: request: GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 HTTP/1.1 Nov 02 14:46:19.738748 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Accept: application/json Nov 02 14:46:19.738748 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Accept-Encoding: identity Nov 02 14:46:19.738748 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Connection: close Nov 02 14:46:19.738748 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Content-Length: 0 Nov 02 14:46:19.738748 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Content-Type: application/json Nov 02 14:46:19.738748 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Host: 10.222.0.30 Nov 02 14:46:19.738748 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Openstack-System-Scope: None Nov 02 14:46:19.738748 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: User-Agent: python-urllib3/1.26.12 Nov 02 14:46:19.738748 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Auth-Token: gAAAAABjYoEkFJKJS2lt8KshFJGdx2NEfLWDhPwL4YYGw9SFu0awBIu7966guJpTDjs56OpHNa7daud6PAHKsdpmpdXfOP2zWw0H05_qrMGJfZnWnpj1zak-PExJb8mq2kkTkBHor4I9084tz2329eTNzpWTCNaBl5rtX6JTJptZi_8U-4cw80U Nov 02 14:46:19.738748 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Domain-Id: None Nov 02 14:46:19.738748 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Domain-Name: None Nov 02 14:46:19.738748 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Identity-Status: Confirmed Nov 02 14:46:19.738748 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Is-Admin-Project: True Nov 02 14:46:19.738748 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 14:46:19.738748 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Domain-Id: default Nov 02 14:46:19.738748 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Domain-Name: Default Nov 02 14:46:19.738748 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Id: 0dd67ec4f08d4d548af5b5ccee50407c Nov 02 14:46:19.738748 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1789775418 Nov 02 14:46:19.738748 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Role: reader,member Nov 02 14:46:19.738748 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Roles: reader,member Nov 02 14:46:19.740549 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0dd67ec4f08d4d548af5b5ccee50407c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0dd67ec4f08d4d548af5b5ccee50407c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0dd67ec4f08d4d548af5b5ccee50407c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0dd67ec4f08d4d548af5b5ccee50407c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:46:19.740549 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1789775418 Nov 02 14:46:19.740549 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant-Id: 0dd67ec4f08d4d548af5b5ccee50407c Nov 02 14:46:19.740549 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1789775418 Nov 02 14:46:19.740549 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User: tempest-AttachVolumeShelveTestJSON-1789775418-project Nov 02 14:46:19.740549 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Domain-Id: default Nov 02 14:46:19.740549 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Domain-Name: Default Nov 02 14:46:19.740549 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Id: eb0b112497dc4b64a9ea2f09f808646d Nov 02 14:46:19.740549 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1789775418-project Nov 02 14:46:19.740549 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: method: > Nov 02 14:46:19.740549 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: exception: Instance ea6a4066-de22-411b-9e4b-1531cb199bc0 could not be found. Nov 02 14:46:19.740549 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: action_args: {'id': 'ea6a4066-de22-411b-9e4b-1531cb199bc0'} Nov 02 14:46:19.741965 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:46:19.741965 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:46:19.741965 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:46:19.741965 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:46:19.741965 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:46:19.741965 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:46:19.741965 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:46:19.741965 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:46:19.741965 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:46:19.741965 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:46:19.741965 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea6a4066-de22-411b-9e4b-1531cb199bc0 could not be found. Nov 02 14:46:19.741965 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:46:19.741965 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:46:19.741965 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:46:19.741965 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:46:19.741965 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:46:19.741965 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:46:19.741965 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:46:19.741965 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:46:19.741965 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:46:19.743488 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:46:19.743488 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:46:19.743488 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:46:19.743488 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:46:19.743488 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:46:19.743488 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:46:19.743488 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:46:19.743488 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea6a4066-de22-411b-9e4b-1531cb199bc0 could not be found. Nov 02 14:46:19.743488 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:46:19.743488 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:46:19.743488 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:46:19.743488 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:46:19.743488 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:46:19.743488 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:46:19.743488 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:46:19.743488 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:46:19.743488 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea6a4066-de22-411b-9e4b-1531cb199bc0 could not be found. Nov 02 14:46:19.743488 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:46:19.745264 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-7e82874a-5ed9-430f-8ca8-3db1e93f74a3 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Returning 404 to user: Instance ea6a4066-de22-411b-9e4b-1531cb199bc0 could not be found. {{(pid=119658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:46:19.745264 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-7e82874a-5ed9-430f-8ca8-3db1e93f74a3 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0" status: 404 len: 111 microversion: 2.20 time: 0.033933 Nov 02 14:46:19.745264 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 364/748] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:46:19 2022] GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 14:46:19.753872 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-a559e939-a12d-494a-87e4-d778af97bc32 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '.version_select at 0x7fb24ec8b9d0>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:19.828369 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-87e06912-7d58-4326-9731-89b3d0fa7cbb tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:19.828992 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-87e06912-7d58-4326-9731-89b3d0fa7cbb tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:19.835810 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-87e06912-7d58-4326-9731-89b3d0fa7cbb tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:19.836313 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-87e06912-7d58-4326-9731-89b3d0fa7cbb tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:19.836802 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-87e06912-7d58-4326-9731-89b3d0fa7cbb tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:19.837580 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-87e06912-7d58-4326-9731-89b3d0fa7cbb tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:19.838205 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-87e06912-7d58-4326-9731-89b3d0fa7cbb tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:19.840769 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-87e06912-7d58-4326-9731-89b3d0fa7cbb tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:19.842994 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-a559e939-a12d-494a-87e4-d778af97bc32 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1231055028" status: 204 len: 0 microversion: 2.20 time: 0.095612 Nov 02 14:46:19.847160 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 385/749] 10.222.0.30 () {60 vars in 1262 bytes} [Wed Nov 2 14:46:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1231055028 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 14:46:19.999196 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-87e06912-7d58-4326-9731-89b3d0fa7cbb tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:20.007936 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-87e06912-7d58-4326-9731-89b3d0fa7cbb tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290" status: 200 len: 1723 microversion: 2.1 time: 0.183994 Nov 02 14:46:20.008752 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 365/750] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:46:19 2022] GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:46:21.033479 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-c287b6c9-07b0-4044-b022-de200a7be660 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:21.034205 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-c287b6c9-07b0-4044-b022-de200a7be660 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:21.040916 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c287b6c9-07b0-4044-b022-de200a7be660 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:21.041417 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c287b6c9-07b0-4044-b022-de200a7be660 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:21.041848 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c287b6c9-07b0-4044-b022-de200a7be660 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:21.042537 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c287b6c9-07b0-4044-b022-de200a7be660 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:21.042982 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c287b6c9-07b0-4044-b022-de200a7be660 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:21.043399 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c287b6c9-07b0-4044-b022-de200a7be660 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:21.181694 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-c287b6c9-07b0-4044-b022-de200a7be660 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:21.190233 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-c287b6c9-07b0-4044-b022-de200a7be660 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290" status: 200 len: 1723 microversion: 2.1 time: 0.161287 Nov 02 14:46:21.192704 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 386/751] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:46:21 2022] GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:46:21.924015 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-dd9df399-553b-42dd-8ee5-8e5b598f0d71 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:21.924516 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-dd9df399-553b-42dd-8ee5-8e5b598f0d71 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:21.930987 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-dd9df399-553b-42dd-8ee5-8e5b598f0d71 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:21.931495 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-dd9df399-553b-42dd-8ee5-8e5b598f0d71 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:21.931936 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-dd9df399-553b-42dd-8ee5-8e5b598f0d71 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:21.932624 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-dd9df399-553b-42dd-8ee5-8e5b598f0d71 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:21.933099 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-dd9df399-553b-42dd-8ee5-8e5b598f0d71 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:21.933524 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-dd9df399-553b-42dd-8ee5-8e5b598f0d71 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:21.946782 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.wsgi [None req-dd9df399-553b-42dd-8ee5-8e5b598f0d71 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] HTTP exception thrown: Instance ea6a4066-de22-411b-9e4b-1531cb199bc0 could not be found. Nov 02 14:46:21.948342 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-dd9df399-553b-42dd-8ee5-8e5b598f0d71 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Request method failure captured: Nov 02 14:46:21.948342 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: request: DELETE /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 HTTP/1.1 Nov 02 14:46:21.948342 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Accept: application/json Nov 02 14:46:21.948342 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Accept-Encoding: identity Nov 02 14:46:21.948342 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Connection: close Nov 02 14:46:21.948342 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Content-Length: 0 Nov 02 14:46:21.948342 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Content-Type: application/json Nov 02 14:46:21.948342 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Host: 10.222.0.30 Nov 02 14:46:21.948342 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Openstack-System-Scope: None Nov 02 14:46:21.948342 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: User-Agent: python-urllib3/1.26.12 Nov 02 14:46:21.948342 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Auth-Token: gAAAAABjYoEkFJKJS2lt8KshFJGdx2NEfLWDhPwL4YYGw9SFu0awBIu7966guJpTDjs56OpHNa7daud6PAHKsdpmpdXfOP2zWw0H05_qrMGJfZnWnpj1zak-PExJb8mq2kkTkBHor4I9084tz2329eTNzpWTCNaBl5rtX6JTJptZi_8U-4cw80U Nov 02 14:46:21.948342 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Domain-Id: None Nov 02 14:46:21.948342 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Domain-Name: None Nov 02 14:46:21.948342 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Identity-Status: Confirmed Nov 02 14:46:21.948342 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Is-Admin-Project: True Nov 02 14:46:21.948342 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 14:46:21.948342 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Domain-Id: default Nov 02 14:46:21.948342 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Domain-Name: Default Nov 02 14:46:21.948342 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Id: 0dd67ec4f08d4d548af5b5ccee50407c Nov 02 14:46:21.948342 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1789775418 Nov 02 14:46:21.948342 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Role: reader,member Nov 02 14:46:21.948342 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Roles: reader,member Nov 02 14:46:21.950086 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0dd67ec4f08d4d548af5b5ccee50407c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0dd67ec4f08d4d548af5b5ccee50407c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0dd67ec4f08d4d548af5b5ccee50407c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0dd67ec4f08d4d548af5b5ccee50407c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:46:21.950086 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1789775418 Nov 02 14:46:21.950086 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant-Id: 0dd67ec4f08d4d548af5b5ccee50407c Nov 02 14:46:21.950086 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1789775418 Nov 02 14:46:21.950086 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User: tempest-AttachVolumeShelveTestJSON-1789775418-project Nov 02 14:46:21.950086 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Domain-Id: default Nov 02 14:46:21.950086 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Domain-Name: Default Nov 02 14:46:21.950086 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Id: eb0b112497dc4b64a9ea2f09f808646d Nov 02 14:46:21.950086 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1789775418-project Nov 02 14:46:21.950086 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: method: > Nov 02 14:46:21.950086 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: exception: Instance ea6a4066-de22-411b-9e4b-1531cb199bc0 could not be found. Nov 02 14:46:21.950086 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: action_args: {'id': 'ea6a4066-de22-411b-9e4b-1531cb199bc0'} Nov 02 14:46:21.950954 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:46:21.950954 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:46:21.950954 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:46:21.950954 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:46:21.950954 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:46:21.950954 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:46:21.950954 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:46:21.950954 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:46:21.950954 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:46:21.950954 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:46:21.950954 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea6a4066-de22-411b-9e4b-1531cb199bc0 could not be found. Nov 02 14:46:21.950954 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:46:21.950954 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:46:21.950954 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:46:21.950954 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:46:21.950954 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:46:21.950954 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:46:21.950954 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:46:21.950954 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:46:21.950954 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:46:21.952387 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:46:21.952387 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:46:21.952387 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:46:21.952387 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:46:21.952387 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:46:21.952387 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:46:21.952387 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:46:21.952387 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:46:21.952387 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:46:21.952387 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea6a4066-de22-411b-9e4b-1531cb199bc0 could not be found. Nov 02 14:46:21.952387 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:46:21.952387 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:46:21.952387 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:46:21.952387 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:46:21.952387 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:46:21.952387 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:46:21.952387 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:46:21.952387 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:46:21.952387 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea6a4066-de22-411b-9e4b-1531cb199bc0 could not be found. Nov 02 14:46:21.952387 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:46:21.953781 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-dd9df399-553b-42dd-8ee5-8e5b598f0d71 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Returning 404 to user: Instance ea6a4066-de22-411b-9e4b-1531cb199bc0 could not be found. {{(pid=119658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:46:21.953781 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-dd9df399-553b-42dd-8ee5-8e5b598f0d71 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0" status: 404 len: 111 microversion: 2.20 time: 0.029596 Nov 02 14:46:21.953781 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 366/752] 10.222.0.30 () {60 vars in 1280 bytes} [Wed Nov 2 14:46:21 2022] DELETE /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 14:46:21.958754 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-3f2cc345-25a0-4828-b0c6-19b596683efc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:21.959437 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-3f2cc345-25a0-4828-b0c6-19b596683efc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: ea6a4066-de22-411b-9e4b-1531cb199bc0] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:21.966144 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3f2cc345-25a0-4828-b0c6-19b596683efc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:21.966670 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3f2cc345-25a0-4828-b0c6-19b596683efc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:21.967111 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3f2cc345-25a0-4828-b0c6-19b596683efc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:21.967804 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3f2cc345-25a0-4828-b0c6-19b596683efc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:21.968255 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3f2cc345-25a0-4828-b0c6-19b596683efc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:21.968682 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3f2cc345-25a0-4828-b0c6-19b596683efc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:21.982637 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.wsgi [None req-3f2cc345-25a0-4828-b0c6-19b596683efc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] HTTP exception thrown: Instance ea6a4066-de22-411b-9e4b-1531cb199bc0 could not be found. Nov 02 14:46:21.984287 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-3f2cc345-25a0-4828-b0c6-19b596683efc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Request method failure captured: Nov 02 14:46:21.984287 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: request: GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 HTTP/1.1 Nov 02 14:46:21.984287 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Accept: application/json Nov 02 14:46:21.984287 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Accept-Encoding: identity Nov 02 14:46:21.984287 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Connection: close Nov 02 14:46:21.984287 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Content-Length: 0 Nov 02 14:46:21.984287 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Content-Type: application/json Nov 02 14:46:21.984287 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Host: 10.222.0.30 Nov 02 14:46:21.984287 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Openstack-System-Scope: None Nov 02 14:46:21.984287 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: User-Agent: python-urllib3/1.26.12 Nov 02 14:46:21.984287 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Auth-Token: gAAAAABjYoEkFJKJS2lt8KshFJGdx2NEfLWDhPwL4YYGw9SFu0awBIu7966guJpTDjs56OpHNa7daud6PAHKsdpmpdXfOP2zWw0H05_qrMGJfZnWnpj1zak-PExJb8mq2kkTkBHor4I9084tz2329eTNzpWTCNaBl5rtX6JTJptZi_8U-4cw80U Nov 02 14:46:21.984287 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Domain-Id: None Nov 02 14:46:21.984287 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Domain-Name: None Nov 02 14:46:21.984287 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Identity-Status: Confirmed Nov 02 14:46:21.984287 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Is-Admin-Project: True Nov 02 14:46:21.984287 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 14:46:21.984287 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Domain-Id: default Nov 02 14:46:21.984287 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Domain-Name: Default Nov 02 14:46:21.984287 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Id: 0dd67ec4f08d4d548af5b5ccee50407c Nov 02 14:46:21.984287 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1789775418 Nov 02 14:46:21.984287 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Role: reader,member Nov 02 14:46:21.984287 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Roles: reader,member Nov 02 14:46:21.985970 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0dd67ec4f08d4d548af5b5ccee50407c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0dd67ec4f08d4d548af5b5ccee50407c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0dd67ec4f08d4d548af5b5ccee50407c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0dd67ec4f08d4d548af5b5ccee50407c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:46:21.985970 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1789775418 Nov 02 14:46:21.985970 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant-Id: 0dd67ec4f08d4d548af5b5ccee50407c Nov 02 14:46:21.985970 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1789775418 Nov 02 14:46:21.985970 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User: tempest-AttachVolumeShelveTestJSON-1789775418-project Nov 02 14:46:21.985970 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Domain-Id: default Nov 02 14:46:21.985970 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Domain-Name: Default Nov 02 14:46:21.985970 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Id: eb0b112497dc4b64a9ea2f09f808646d Nov 02 14:46:21.985970 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1789775418-project Nov 02 14:46:21.985970 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: method: > Nov 02 14:46:21.985970 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: exception: Instance ea6a4066-de22-411b-9e4b-1531cb199bc0 could not be found. Nov 02 14:46:21.985970 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: action_args: {'id': 'ea6a4066-de22-411b-9e4b-1531cb199bc0'} Nov 02 14:46:21.986864 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:46:21.986864 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:46:21.986864 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:46:21.986864 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:46:21.986864 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:46:21.986864 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:46:21.986864 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:46:21.986864 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:46:21.986864 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:46:21.986864 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:46:21.986864 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea6a4066-de22-411b-9e4b-1531cb199bc0 could not be found. Nov 02 14:46:21.986864 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:46:21.986864 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:46:21.986864 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:46:21.986864 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:46:21.986864 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:46:21.986864 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:46:21.986864 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:46:21.986864 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:46:21.986864 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:46:21.988377 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:46:21.988377 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:46:21.988377 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:46:21.988377 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:46:21.988377 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:46:21.988377 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:46:21.988377 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:46:21.988377 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea6a4066-de22-411b-9e4b-1531cb199bc0 could not be found. Nov 02 14:46:21.988377 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:46:21.988377 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:46:21.988377 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:46:21.988377 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:46:21.988377 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:46:21.988377 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:46:21.988377 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:46:21.988377 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:46:21.988377 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea6a4066-de22-411b-9e4b-1531cb199bc0 could not be found. Nov 02 14:46:21.988377 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:46:21.989884 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-3f2cc345-25a0-4828-b0c6-19b596683efc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Returning 404 to user: Instance ea6a4066-de22-411b-9e4b-1531cb199bc0 could not be found. {{(pid=119659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:46:21.989884 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-3f2cc345-25a0-4828-b0c6-19b596683efc tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0" status: 404 len: 111 microversion: 2.20 time: 0.030875 Nov 02 14:46:21.989884 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 387/753] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:46:21 2022] GET /compute/v2.1/servers/ea6a4066-de22-411b-9e4b-1531cb199bc0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 14:46:22.214303 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-ae5184e9-b984-4eb7-87be-7ba9c2763b09 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:22.214913 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-ae5184e9-b984-4eb7-87be-7ba9c2763b09 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:22.221602 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ae5184e9-b984-4eb7-87be-7ba9c2763b09 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:22.222088 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ae5184e9-b984-4eb7-87be-7ba9c2763b09 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:22.222567 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ae5184e9-b984-4eb7-87be-7ba9c2763b09 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:22.223210 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ae5184e9-b984-4eb7-87be-7ba9c2763b09 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:22.223660 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ae5184e9-b984-4eb7-87be-7ba9c2763b09 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:22.224085 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ae5184e9-b984-4eb7-87be-7ba9c2763b09 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:22.358048 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-ae5184e9-b984-4eb7-87be-7ba9c2763b09 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:22.366659 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-ae5184e9-b984-4eb7-87be-7ba9c2763b09 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290" status: 200 len: 1723 microversion: 2.1 time: 0.156177 Nov 02 14:46:22.367227 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 367/754] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:46:22 2022] GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:46:23.230497 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-10b53574-3184-4022-99d2-2adb23a23f8b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:23.231056 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-10b53574-3184-4022-99d2-2adb23a23f8b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:23.238711 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-10b53574-3184-4022-99d2-2adb23a23f8b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:23.239436 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-10b53574-3184-4022-99d2-2adb23a23f8b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:23.239882 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-10b53574-3184-4022-99d2-2adb23a23f8b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:23.240580 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-10b53574-3184-4022-99d2-2adb23a23f8b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:23.241057 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-10b53574-3184-4022-99d2-2adb23a23f8b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:23.241487 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-10b53574-3184-4022-99d2-2adb23a23f8b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:23.255517 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.wsgi [None req-10b53574-3184-4022-99d2-2adb23a23f8b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] HTTP exception thrown: Instance 5d0f8129-8155-4b7c-a462-f9c067ecfbca could not be found. Nov 02 14:46:23.257103 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-10b53574-3184-4022-99d2-2adb23a23f8b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Request method failure captured: Nov 02 14:46:23.257103 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: request: DELETE /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca HTTP/1.1 Nov 02 14:46:23.257103 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Accept: application/json Nov 02 14:46:23.257103 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Accept-Encoding: identity Nov 02 14:46:23.257103 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Connection: close Nov 02 14:46:23.257103 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Content-Length: 0 Nov 02 14:46:23.257103 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Content-Type: application/json Nov 02 14:46:23.257103 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Host: 10.222.0.30 Nov 02 14:46:23.257103 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Openstack-System-Scope: None Nov 02 14:46:23.257103 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: User-Agent: python-urllib3/1.26.12 Nov 02 14:46:23.257103 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Auth-Token: gAAAAABjYoEkFJKJS2lt8KshFJGdx2NEfLWDhPwL4YYGw9SFu0awBIu7966guJpTDjs56OpHNa7daud6PAHKsdpmpdXfOP2zWw0H05_qrMGJfZnWnpj1zak-PExJb8mq2kkTkBHor4I9084tz2329eTNzpWTCNaBl5rtX6JTJptZi_8U-4cw80U Nov 02 14:46:23.257103 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Domain-Id: None Nov 02 14:46:23.257103 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Domain-Name: None Nov 02 14:46:23.257103 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Identity-Status: Confirmed Nov 02 14:46:23.257103 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Is-Admin-Project: True Nov 02 14:46:23.257103 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 14:46:23.257103 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Domain-Id: default Nov 02 14:46:23.257103 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Domain-Name: Default Nov 02 14:46:23.257103 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Id: 0dd67ec4f08d4d548af5b5ccee50407c Nov 02 14:46:23.257103 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1789775418 Nov 02 14:46:23.257103 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Role: reader,member Nov 02 14:46:23.257103 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Roles: reader,member Nov 02 14:46:23.258739 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0dd67ec4f08d4d548af5b5ccee50407c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0dd67ec4f08d4d548af5b5ccee50407c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0dd67ec4f08d4d548af5b5ccee50407c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0dd67ec4f08d4d548af5b5ccee50407c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:46:23.258739 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1789775418 Nov 02 14:46:23.258739 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant-Id: 0dd67ec4f08d4d548af5b5ccee50407c Nov 02 14:46:23.258739 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1789775418 Nov 02 14:46:23.258739 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User: tempest-AttachVolumeShelveTestJSON-1789775418-project Nov 02 14:46:23.258739 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Domain-Id: default Nov 02 14:46:23.258739 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Domain-Name: Default Nov 02 14:46:23.258739 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Id: eb0b112497dc4b64a9ea2f09f808646d Nov 02 14:46:23.258739 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1789775418-project Nov 02 14:46:23.258739 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: method: > Nov 02 14:46:23.258739 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: exception: Instance 5d0f8129-8155-4b7c-a462-f9c067ecfbca could not be found. Nov 02 14:46:23.258739 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: action_args: {'id': '5d0f8129-8155-4b7c-a462-f9c067ecfbca'} Nov 02 14:46:23.259547 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:46:23.259547 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:46:23.259547 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:46:23.259547 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:46:23.259547 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:46:23.259547 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:46:23.259547 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:46:23.259547 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:46:23.259547 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:46:23.259547 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:46:23.259547 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d0f8129-8155-4b7c-a462-f9c067ecfbca could not be found. Nov 02 14:46:23.259547 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:46:23.259547 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:46:23.259547 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:46:23.259547 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:46:23.259547 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:46:23.259547 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:46:23.259547 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:46:23.259547 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:46:23.259547 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:46:23.260799 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:46:23.260799 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:46:23.260799 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:46:23.260799 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:46:23.260799 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:46:23.260799 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:46:23.260799 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:46:23.260799 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:46:23.260799 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:46:23.260799 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d0f8129-8155-4b7c-a462-f9c067ecfbca could not be found. Nov 02 14:46:23.260799 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:46:23.260799 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:46:23.260799 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:46:23.260799 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:46:23.260799 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:46:23.260799 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:46:23.260799 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:46:23.260799 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:46:23.260799 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d0f8129-8155-4b7c-a462-f9c067ecfbca could not be found. Nov 02 14:46:23.260799 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:46:23.262077 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-10b53574-3184-4022-99d2-2adb23a23f8b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Returning 404 to user: Instance 5d0f8129-8155-4b7c-a462-f9c067ecfbca could not be found. {{(pid=119659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:46:23.262077 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-10b53574-3184-4022-99d2-2adb23a23f8b tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 404 len: 111 microversion: 2.20 time: 0.031846 Nov 02 14:46:23.262077 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 388/755] 10.222.0.30 () {60 vars in 1280 bytes} [Wed Nov 2 14:46:23 2022] DELETE /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 14:46:23.267175 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-adf6426c-e74e-49b0-82b0-b388070a9192 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:23.267791 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-adf6426c-e74e-49b0-82b0-b388070a9192 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] [instance: 5d0f8129-8155-4b7c-a462-f9c067ecfbca] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:23.274275 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-adf6426c-e74e-49b0-82b0-b388070a9192 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:23.274761 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-adf6426c-e74e-49b0-82b0-b388070a9192 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:23.275202 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-adf6426c-e74e-49b0-82b0-b388070a9192 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:23.275895 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-adf6426c-e74e-49b0-82b0-b388070a9192 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:23.276349 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-adf6426c-e74e-49b0-82b0-b388070a9192 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:23.276776 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-adf6426c-e74e-49b0-82b0-b388070a9192 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:23.292811 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.wsgi [None req-adf6426c-e74e-49b0-82b0-b388070a9192 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] HTTP exception thrown: Instance 5d0f8129-8155-4b7c-a462-f9c067ecfbca could not be found. Nov 02 14:46:23.295013 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-adf6426c-e74e-49b0-82b0-b388070a9192 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Request method failure captured: Nov 02 14:46:23.295013 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: request: GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca HTTP/1.1 Nov 02 14:46:23.295013 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Accept: application/json Nov 02 14:46:23.295013 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Accept-Encoding: identity Nov 02 14:46:23.295013 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Connection: close Nov 02 14:46:23.295013 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Content-Length: 0 Nov 02 14:46:23.295013 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Content-Type: application/json Nov 02 14:46:23.295013 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Host: 10.222.0.30 Nov 02 14:46:23.295013 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Openstack-System-Scope: None Nov 02 14:46:23.295013 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: User-Agent: python-urllib3/1.26.12 Nov 02 14:46:23.295013 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Auth-Token: gAAAAABjYoEkFJKJS2lt8KshFJGdx2NEfLWDhPwL4YYGw9SFu0awBIu7966guJpTDjs56OpHNa7daud6PAHKsdpmpdXfOP2zWw0H05_qrMGJfZnWnpj1zak-PExJb8mq2kkTkBHor4I9084tz2329eTNzpWTCNaBl5rtX6JTJptZi_8U-4cw80U Nov 02 14:46:23.295013 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Domain-Id: None Nov 02 14:46:23.295013 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Domain-Name: None Nov 02 14:46:23.295013 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Identity-Status: Confirmed Nov 02 14:46:23.295013 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Is-Admin-Project: True Nov 02 14:46:23.295013 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 14:46:23.295013 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Domain-Id: default Nov 02 14:46:23.295013 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Domain-Name: Default Nov 02 14:46:23.295013 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Id: 0dd67ec4f08d4d548af5b5ccee50407c Nov 02 14:46:23.295013 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1789775418 Nov 02 14:46:23.295013 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Role: reader,member Nov 02 14:46:23.295013 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Roles: reader,member Nov 02 14:46:23.296723 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0dd67ec4f08d4d548af5b5ccee50407c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0dd67ec4f08d4d548af5b5ccee50407c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0dd67ec4f08d4d548af5b5ccee50407c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0dd67ec4f08d4d548af5b5ccee50407c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:46:23.296723 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1789775418 Nov 02 14:46:23.296723 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant-Id: 0dd67ec4f08d4d548af5b5ccee50407c Nov 02 14:46:23.296723 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1789775418 Nov 02 14:46:23.296723 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User: tempest-AttachVolumeShelveTestJSON-1789775418-project Nov 02 14:46:23.296723 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Domain-Id: default Nov 02 14:46:23.296723 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Domain-Name: Default Nov 02 14:46:23.296723 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Id: eb0b112497dc4b64a9ea2f09f808646d Nov 02 14:46:23.296723 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1789775418-project Nov 02 14:46:23.296723 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: method: > Nov 02 14:46:23.296723 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: exception: Instance 5d0f8129-8155-4b7c-a462-f9c067ecfbca could not be found. Nov 02 14:46:23.296723 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: action_args: {'id': '5d0f8129-8155-4b7c-a462-f9c067ecfbca'} Nov 02 14:46:23.297743 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:46:23.297743 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:46:23.297743 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:46:23.297743 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:46:23.297743 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:46:23.297743 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:46:23.297743 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:46:23.297743 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:46:23.297743 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:46:23.297743 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:46:23.297743 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d0f8129-8155-4b7c-a462-f9c067ecfbca could not be found. Nov 02 14:46:23.297743 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:46:23.297743 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:46:23.297743 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:46:23.297743 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:46:23.297743 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:46:23.297743 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:46:23.297743 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:46:23.297743 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:46:23.297743 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:46:23.299205 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:46:23.299205 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:46:23.299205 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:46:23.299205 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:46:23.299205 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:46:23.299205 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:46:23.299205 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:46:23.299205 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d0f8129-8155-4b7c-a462-f9c067ecfbca could not be found. Nov 02 14:46:23.299205 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:46:23.299205 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:46:23.299205 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:46:23.299205 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:46:23.299205 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:46:23.299205 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:46:23.299205 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:46:23.299205 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:46:23.299205 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d0f8129-8155-4b7c-a462-f9c067ecfbca could not be found. Nov 02 14:46:23.299205 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:46:23.300577 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-adf6426c-e74e-49b0-82b0-b388070a9192 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] Returning 404 to user: Instance 5d0f8129-8155-4b7c-a462-f9c067ecfbca could not be found. {{(pid=119658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:46:23.300577 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-adf6426c-e74e-49b0-82b0-b388070a9192 tempest-AttachVolumeShelveTestJSON-1789775418 tempest-AttachVolumeShelveTestJSON-1789775418-project] 10.222.0.30 "GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca" status: 404 len: 111 microversion: 2.20 time: 0.033142 Nov 02 14:46:23.300577 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 368/756] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Nov 2 14:46:23 2022] GET /compute/v2.1/servers/5d0f8129-8155-4b7c-a462-f9c067ecfbca => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 14:46:23.391506 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-1dd5fd61-8b62-462a-952d-9b85b1b86071 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:23.392123 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-1dd5fd61-8b62-462a-952d-9b85b1b86071 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:23.398272 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1dd5fd61-8b62-462a-952d-9b85b1b86071 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:23.398763 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1dd5fd61-8b62-462a-952d-9b85b1b86071 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:23.399211 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1dd5fd61-8b62-462a-952d-9b85b1b86071 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:23.399901 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1dd5fd61-8b62-462a-952d-9b85b1b86071 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:23.400426 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1dd5fd61-8b62-462a-952d-9b85b1b86071 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:23.400858 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1dd5fd61-8b62-462a-952d-9b85b1b86071 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:23.621881 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-1dd5fd61-8b62-462a-952d-9b85b1b86071 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:23.630316 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-1dd5fd61-8b62-462a-952d-9b85b1b86071 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290" status: 200 len: 1723 microversion: 2.1 time: 0.243151 Nov 02 14:46:23.634628 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 389/757] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:46:23 2022] GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290 => generated 1723 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:46:24.656828 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-cb0d9678-3c43-4c99-bd45-b72e03f3c22d tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:24.663203 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-cb0d9678-3c43-4c99-bd45-b72e03f3c22d tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:24.675897 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-cb0d9678-3c43-4c99-bd45-b72e03f3c22d tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:24.679482 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-cb0d9678-3c43-4c99-bd45-b72e03f3c22d tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:24.680267 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-cb0d9678-3c43-4c99-bd45-b72e03f3c22d tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:24.681296 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-cb0d9678-3c43-4c99-bd45-b72e03f3c22d tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:24.682031 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-cb0d9678-3c43-4c99-bd45-b72e03f3c22d tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:24.685449 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-cb0d9678-3c43-4c99-bd45-b72e03f3c22d tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:24.893987 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-cb0d9678-3c43-4c99-bd45-b72e03f3c22d tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:24.906972 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-cb0d9678-3c43-4c99-bd45-b72e03f3c22d tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290" status: 200 len: 1723 microversion: 2.1 time: 0.255354 Nov 02 14:46:24.908796 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 369/758] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:46:24 2022] GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290 => generated 1723 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:46:25.931803 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-1dd1078c-a984-4e1d-819c-1d4b30c0db19 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:25.932411 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-1dd1078c-a984-4e1d-819c-1d4b30c0db19 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:25.939646 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1dd1078c-a984-4e1d-819c-1d4b30c0db19 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:25.940143 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1dd1078c-a984-4e1d-819c-1d4b30c0db19 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:25.940579 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1dd1078c-a984-4e1d-819c-1d4b30c0db19 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:25.941578 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1dd1078c-a984-4e1d-819c-1d4b30c0db19 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:25.942202 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1dd1078c-a984-4e1d-819c-1d4b30c0db19 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:25.942642 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1dd1078c-a984-4e1d-819c-1d4b30c0db19 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:26.135251 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-1dd1078c-a984-4e1d-819c-1d4b30c0db19 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:26.144089 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-1dd1078c-a984-4e1d-819c-1d4b30c0db19 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290" status: 200 len: 1723 microversion: 2.1 time: 0.216170 Nov 02 14:46:26.145696 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 390/759] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:46:25 2022] GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290 => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:46:27.167701 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-85116f18-8124-44bd-b6a4-32568e59ff42 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:27.168308 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-85116f18-8124-44bd-b6a4-32568e59ff42 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:27.175204 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-85116f18-8124-44bd-b6a4-32568e59ff42 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:27.177271 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-85116f18-8124-44bd-b6a4-32568e59ff42 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:27.177271 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-85116f18-8124-44bd-b6a4-32568e59ff42 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:27.177271 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-85116f18-8124-44bd-b6a4-32568e59ff42 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:27.177271 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-85116f18-8124-44bd-b6a4-32568e59ff42 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:27.177647 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-85116f18-8124-44bd-b6a4-32568e59ff42 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:27.331332 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-85116f18-8124-44bd-b6a4-32568e59ff42 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:27.339972 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-85116f18-8124-44bd-b6a4-32568e59ff42 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290" status: 200 len: 1723 microversion: 2.1 time: 0.176057 Nov 02 14:46:27.341173 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 370/760] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:46:27 2022] GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:46:28.363744 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-5258bd72-d2e1-477f-a5c2-2ccb36f34c13 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:28.364751 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-5258bd72-d2e1-477f-a5c2-2ccb36f34c13 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:28.371741 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5258bd72-d2e1-477f-a5c2-2ccb36f34c13 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:28.372319 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5258bd72-d2e1-477f-a5c2-2ccb36f34c13 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:28.372850 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5258bd72-d2e1-477f-a5c2-2ccb36f34c13 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:28.373591 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5258bd72-d2e1-477f-a5c2-2ccb36f34c13 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:28.374040 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5258bd72-d2e1-477f-a5c2-2ccb36f34c13 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:28.374461 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5258bd72-d2e1-477f-a5c2-2ccb36f34c13 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:28.516965 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-5258bd72-d2e1-477f-a5c2-2ccb36f34c13 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:28.526875 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-5258bd72-d2e1-477f-a5c2-2ccb36f34c13 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290" status: 200 len: 1723 microversion: 2.1 time: 0.166987 Nov 02 14:46:28.527446 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 391/761] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:46:28 2022] GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:46:29.551075 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-9c966221-5e1a-4481-be52-7e7bb1db5f4f tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:29.551701 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-9c966221-5e1a-4481-be52-7e7bb1db5f4f tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:29.554100 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:46:29.558826 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9c966221-5e1a-4481-be52-7e7bb1db5f4f tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:29.559951 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9c966221-5e1a-4481-be52-7e7bb1db5f4f tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:29.560394 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9c966221-5e1a-4481-be52-7e7bb1db5f4f tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:29.561233 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9c966221-5e1a-4481-be52-7e7bb1db5f4f tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:29.561591 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9c966221-5e1a-4481-be52-7e7bb1db5f4f tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:29.562012 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9c966221-5e1a-4481-be52-7e7bb1db5f4f tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:29.564749 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:46:29.766309 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-9c966221-5e1a-4481-be52-7e7bb1db5f4f tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:29.780957 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-9c966221-5e1a-4481-be52-7e7bb1db5f4f tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290" status: 200 len: 1700 microversion: 2.1 time: 0.233674 Nov 02 14:46:29.781638 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 371/762] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:46:29 2022] GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290 => generated 1700 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:46:29.804778 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-4653e75e-058b-4ace-a8e6-74e13242af7f tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:46:29.812401 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4653e75e-058b-4ace-a8e6-74e13242af7f tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:29.812882 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4653e75e-058b-4ace-a8e6-74e13242af7f tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:29.813352 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4653e75e-058b-4ace-a8e6-74e13242af7f tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:29.836570 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-4653e75e-058b-4ace-a8e6-74e13242af7f tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Going to try to start instance {{(pid=119659) start /opt/stack/nova/nova/compute/api.py:2785}} Nov 02 14:46:29.843143 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:46:30.066143 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-4653e75e-058b-4ace-a8e6-74e13242af7f tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "POST /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290/action" status: 202 len: 0 microversion: 2.1 time: 0.264484 Nov 02 14:46:30.066988 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 392/763] 10.222.0.30 () {60 vars in 1278 bytes} [Wed Nov 2 14:46:29 2022] POST /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:46:30.075909 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-5b448c06-8a40-4985-a652-e3a1865d5461 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:30.076612 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-5b448c06-8a40-4985-a652-e3a1865d5461 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:30.083366 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5b448c06-8a40-4985-a652-e3a1865d5461 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:30.083950 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5b448c06-8a40-4985-a652-e3a1865d5461 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:30.084465 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5b448c06-8a40-4985-a652-e3a1865d5461 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:30.085334 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5b448c06-8a40-4985-a652-e3a1865d5461 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:30.085871 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5b448c06-8a40-4985-a652-e3a1865d5461 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:30.086399 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5b448c06-8a40-4985-a652-e3a1865d5461 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:30.237677 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-5b448c06-8a40-4985-a652-e3a1865d5461 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:30.247711 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-5b448c06-8a40-4985-a652-e3a1865d5461 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290" status: 200 len: 1709 microversion: 2.1 time: 0.175981 Nov 02 14:46:30.250812 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 372/764] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:46:30 2022] GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290 => generated 1709 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:46:31.273167 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-4bb4821b-ecff-4a2c-8c97-234d0082a066 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:31.273981 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-4bb4821b-ecff-4a2c-8c97-234d0082a066 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:31.281628 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4bb4821b-ecff-4a2c-8c97-234d0082a066 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:31.282386 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4bb4821b-ecff-4a2c-8c97-234d0082a066 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:31.282996 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4bb4821b-ecff-4a2c-8c97-234d0082a066 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:31.283917 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4bb4821b-ecff-4a2c-8c97-234d0082a066 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:31.284548 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4bb4821b-ecff-4a2c-8c97-234d0082a066 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:31.285175 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4bb4821b-ecff-4a2c-8c97-234d0082a066 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:31.468819 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-4bb4821b-ecff-4a2c-8c97-234d0082a066 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:31.484940 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-4bb4821b-ecff-4a2c-8c97-234d0082a066 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290" status: 200 len: 1709 microversion: 2.1 time: 0.216763 Nov 02 14:46:31.497040 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 393/765] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:46:31 2022] GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290 => generated 1709 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:46:32.511032 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-6776225c-8686-4b09-90cd-e1222ec1828c tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:32.511684 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-6776225c-8686-4b09-90cd-e1222ec1828c tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:32.520013 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6776225c-8686-4b09-90cd-e1222ec1828c tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:32.520510 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6776225c-8686-4b09-90cd-e1222ec1828c tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:32.520957 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6776225c-8686-4b09-90cd-e1222ec1828c tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:32.522051 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6776225c-8686-4b09-90cd-e1222ec1828c tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:32.522706 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6776225c-8686-4b09-90cd-e1222ec1828c tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:32.523244 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6776225c-8686-4b09-90cd-e1222ec1828c tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:32.780058 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-6776225c-8686-4b09-90cd-e1222ec1828c tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:32.792247 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-6776225c-8686-4b09-90cd-e1222ec1828c tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290" status: 200 len: 1713 microversion: 2.1 time: 0.285144 Nov 02 14:46:32.793538 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 373/766] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:46:32 2022] GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290 => generated 1713 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:46:35.366505 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-13244e98-690c-4b8f-a836-abbae210a909 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Action: 'create', calling method: .version_select at 0x7fb24ed35b80>, body: {"keypair": {"name": "tempest-keypair-365832769", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFwQ7i8b3ceIMohBULOtG5FiFYlUsXNAjujxs73iSEnHD4dO7snC7S2bBNROP5kGxpdd46TP1TI0zRd906QmmSnreayR9ogi4ZTBI6UkY1WX0+3Mo5M9wSxg5ya2q16DGQ=="}} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:46:35.383341 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.quota [None req-13244e98-690c-4b8f-a836-abbae210a909 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Getting quotas for project e428f318654f446db48445e4570ae2d3. Resources: {'key_pairs'} {{(pid=119659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:46:35.387267 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.quota [None req-13244e98-690c-4b8f-a836-abbae210a909 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Getting quotas for user 7fa761a568644a9399d825498a51f054 and project e428f318654f446db48445e4570ae2d3. Resources: {'key_pairs'} {{(pid=119659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:46:35.491563 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-13244e98-690c-4b8f-a836-abbae210a909 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.254741 Nov 02 14:46:35.492224 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 394/767] 10.222.0.30 () {60 vars in 1159 bytes} [Wed Nov 2 14:46:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:46:38.179174 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-eb15a7f0-b910-41d3-9335-9b39708a30e1 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1219258595", "imageRef": "a726a246-cc7f-46e6-aeff-4d62e03cc091", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d6bf9a07-46e7-4c2d-8535-e65644e316a0"}], "security_groups": [{"name": "tempest-securitygroup--1398430664"}], "key_name": "tempest-keypair-365832769", "user_data": "}} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:46:38.302621 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.network.neutron [None req-eb15a7f0-b910-41d3-9335-9b39708a30e1 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] validate_networks() for [('d6bf9a07-46e7-4c2d-8535-e65644e316a0', None, None, None, None, None)] {{(pid=119658) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:46:38.786200 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-eb15a7f0-b910-41d3-9335-9b39708a30e1 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Flavor limits 0:0:0 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:46:38.786621 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-eb15a7f0-b910-41d3-9335-9b39708a30e1 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Image limits 0:0:0 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:46:38.787086 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-eb15a7f0-b910-41d3-9335-9b39708a30e1 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Flavor pref 0:0:0 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:46:38.787754 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-eb15a7f0-b910-41d3-9335-9b39708a30e1 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Image pref 0:0:0 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:46:38.788319 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-eb15a7f0-b910-41d3-9335-9b39708a30e1 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:46:38.798674 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-eb15a7f0-b910-41d3-9335-9b39708a30e1 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:38.799164 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-eb15a7f0-b910-41d3-9335-9b39708a30e1 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:38.799597 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-eb15a7f0-b910-41d3-9335-9b39708a30e1 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:38.800378 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-eb15a7f0-b910-41d3-9335-9b39708a30e1 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:38.800824 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-eb15a7f0-b910-41d3-9335-9b39708a30e1 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:38.804795 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-eb15a7f0-b910-41d3-9335-9b39708a30e1 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:38.824778 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.quota [None req-eb15a7f0-b910-41d3-9335-9b39708a30e1 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Getting quotas for project e428f318654f446db48445e4570ae2d3. Resources: {'instances', 'ram', 'cores'} {{(pid=119658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:46:38.830588 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.quota [None req-eb15a7f0-b910-41d3-9335-9b39708a30e1 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Getting quotas for user 7fa761a568644a9399d825498a51f054 and project e428f318654f446db48445e4570ae2d3. Resources: {'instances', 'ram', 'cores'} {{(pid=119658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:46:38.843058 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-eb15a7f0-b910-41d3-9335-9b39708a30e1 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Going to run 1 instances... {{(pid=119658) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:46:38.845532 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-eb15a7f0-b910-41d3-9335-9b39708a30e1 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 015a2580-2374-494d-a62d-8ea86c25b6d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a726a246-cc7f-46e6-aeff-4d62e03cc091',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119658) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:46:38.975145 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-eb15a7f0-b910-41d3-9335-9b39708a30e1 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.800292 Nov 02 14:46:38.976026 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 374/768] 10.222.0.30 () {60 vars in 1147 bytes} [Wed Nov 2 14:46:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:46:38.989244 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-43d80992-6a80-4192-b1cc-682b7d15e2ce tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:38.990275 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-43d80992-6a80-4192-b1cc-682b7d15e2ce tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 015a2580-2374-494d-a62d-8ea86c25b6d4] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:38.992010 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:46:39.056295 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-43d80992-6a80-4192-b1cc-682b7d15e2ce tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:39.068433 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-43d80992-6a80-4192-b1cc-682b7d15e2ce tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/015a2580-2374-494d-a62d-8ea86c25b6d4" status: 200 len: 1241 microversion: 2.1 time: 0.083723 Nov 02 14:46:39.069078 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 395/769] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:46:38 2022] GET /compute/v2.1/servers/015a2580-2374-494d-a62d-8ea86c25b6d4 => generated 1241 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:46:40.093095 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-8a841449-1506-4750-9dcf-e218be785ef5 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:40.093684 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-8a841449-1506-4750-9dcf-e218be785ef5 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 015a2580-2374-494d-a62d-8ea86c25b6d4] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:40.109894 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8a841449-1506-4750-9dcf-e218be785ef5 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:40.110821 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8a841449-1506-4750-9dcf-e218be785ef5 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:40.111282 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8a841449-1506-4750-9dcf-e218be785ef5 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:40.112020 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8a841449-1506-4750-9dcf-e218be785ef5 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:40.112487 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8a841449-1506-4750-9dcf-e218be785ef5 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:40.112934 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8a841449-1506-4750-9dcf-e218be785ef5 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:40.181413 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-8a841449-1506-4750-9dcf-e218be785ef5 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:40.191669 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-8a841449-1506-4750-9dcf-e218be785ef5 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/015a2580-2374-494d-a62d-8ea86c25b6d4" status: 200 len: 1245 microversion: 2.1 time: 0.103188 Nov 02 14:46:40.192673 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 375/770] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:46:40 2022] GET /compute/v2.1/servers/015a2580-2374-494d-a62d-8ea86c25b6d4 => generated 1245 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:46:41.216602 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-0616de34-a5ad-418d-b3ff-0c42f3ee1b86 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:41.217265 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-0616de34-a5ad-418d-b3ff-0c42f3ee1b86 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 015a2580-2374-494d-a62d-8ea86c25b6d4] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:41.224235 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0616de34-a5ad-418d-b3ff-0c42f3ee1b86 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:41.224721 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0616de34-a5ad-418d-b3ff-0c42f3ee1b86 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:41.225192 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0616de34-a5ad-418d-b3ff-0c42f3ee1b86 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:41.225897 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0616de34-a5ad-418d-b3ff-0c42f3ee1b86 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:41.226346 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0616de34-a5ad-418d-b3ff-0c42f3ee1b86 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:41.226774 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0616de34-a5ad-418d-b3ff-0c42f3ee1b86 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:41.292253 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-0616de34-a5ad-418d-b3ff-0c42f3ee1b86 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:41.300375 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-0616de34-a5ad-418d-b3ff-0c42f3ee1b86 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/015a2580-2374-494d-a62d-8ea86c25b6d4" status: 200 len: 1293 microversion: 2.1 time: 0.088559 Nov 02 14:46:41.300982 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 396/771] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:46:41 2022] GET /compute/v2.1/servers/015a2580-2374-494d-a62d-8ea86c25b6d4 => generated 1293 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:46:42.325878 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-afb35972-f1d9-46fa-99f3-604774584454 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:42.328037 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-afb35972-f1d9-46fa-99f3-604774584454 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 015a2580-2374-494d-a62d-8ea86c25b6d4] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:42.335372 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-afb35972-f1d9-46fa-99f3-604774584454 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:42.335856 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-afb35972-f1d9-46fa-99f3-604774584454 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:42.336291 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-afb35972-f1d9-46fa-99f3-604774584454 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:42.337106 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-afb35972-f1d9-46fa-99f3-604774584454 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:42.337557 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-afb35972-f1d9-46fa-99f3-604774584454 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:42.338181 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-afb35972-f1d9-46fa-99f3-604774584454 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:42.488708 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-afb35972-f1d9-46fa-99f3-604774584454 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:42.497155 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-afb35972-f1d9-46fa-99f3-604774584454 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/015a2580-2374-494d-a62d-8ea86c25b6d4" status: 200 len: 1367 microversion: 2.1 time: 0.175333 Nov 02 14:46:42.498266 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 376/772] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:46:42 2022] GET /compute/v2.1/servers/015a2580-2374-494d-a62d-8ea86c25b6d4 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:46:43.345779 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [req-6c50446b-da67-4f14-8991-625c3f343dc8 req-a731efcd-94b8-408c-a90e-3d36f3be4c03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "015a2580-2374-494d-a62d-8ea86c25b6d4", "tag": "1313078c-90cf-4898-bb7f-d746882578d0"}]} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:46:43.356771 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-6c50446b-da67-4f14-8991-625c3f343dc8 req-a731efcd-94b8-408c-a90e-3d36f3be4c03 service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:43.357270 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-6c50446b-da67-4f14-8991-625c3f343dc8 req-a731efcd-94b8-408c-a90e-3d36f3be4c03 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:43.357721 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-6c50446b-da67-4f14-8991-625c3f343dc8 req-a731efcd-94b8-408c-a90e-3d36f3be4c03 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:43.369366 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.compute.server_external_events [req-6c50446b-da67-4f14-8991-625c3f343dc8 req-a731efcd-94b8-408c-a90e-3d36f3be4c03 service nova] Creating event network-changed:1313078c-90cf-4898-bb7f-d746882578d0 for instance 015a2580-2374-494d-a62d-8ea86c25b6d4 on hv-cinder-86236 Nov 02 14:46:43.375216 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [req-6c50446b-da67-4f14-8991-625c3f343dc8 req-a731efcd-94b8-408c-a90e-3d36f3be4c03 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033855 Nov 02 14:46:43.375817 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 397/773] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:46:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:46:43.519523 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-819dbfac-8743-4635-bcb0-3b31fcd7fd92 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:43.520135 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-819dbfac-8743-4635-bcb0-3b31fcd7fd92 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 015a2580-2374-494d-a62d-8ea86c25b6d4] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:43.526745 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-819dbfac-8743-4635-bcb0-3b31fcd7fd92 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:43.527230 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-819dbfac-8743-4635-bcb0-3b31fcd7fd92 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:43.527752 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-819dbfac-8743-4635-bcb0-3b31fcd7fd92 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:43.528436 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-819dbfac-8743-4635-bcb0-3b31fcd7fd92 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:43.528888 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-819dbfac-8743-4635-bcb0-3b31fcd7fd92 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:43.529352 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-819dbfac-8743-4635-bcb0-3b31fcd7fd92 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:43.753694 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-819dbfac-8743-4635-bcb0-3b31fcd7fd92 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:43.761342 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-819dbfac-8743-4635-bcb0-3b31fcd7fd92 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/015a2580-2374-494d-a62d-8ea86c25b6d4" status: 200 len: 1367 microversion: 2.1 time: 0.245659 Nov 02 14:46:43.762042 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 377/774] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:46:43 2022] GET /compute/v2.1/servers/015a2580-2374-494d-a62d-8ea86c25b6d4 => generated 1367 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:46:44.784830 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-b0535b18-3482-4daa-b5e4-2c02759a5a9d tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:44.785563 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-b0535b18-3482-4daa-b5e4-2c02759a5a9d tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 015a2580-2374-494d-a62d-8ea86c25b6d4] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:44.792293 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b0535b18-3482-4daa-b5e4-2c02759a5a9d tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:44.792781 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b0535b18-3482-4daa-b5e4-2c02759a5a9d tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:44.793971 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b0535b18-3482-4daa-b5e4-2c02759a5a9d tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:44.794684 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b0535b18-3482-4daa-b5e4-2c02759a5a9d tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:44.795152 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b0535b18-3482-4daa-b5e4-2c02759a5a9d tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:44.797923 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b0535b18-3482-4daa-b5e4-2c02759a5a9d tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:44.929649 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-b0535b18-3482-4daa-b5e4-2c02759a5a9d tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:44.937396 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-b0535b18-3482-4daa-b5e4-2c02759a5a9d tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/015a2580-2374-494d-a62d-8ea86c25b6d4" status: 200 len: 1367 microversion: 2.1 time: 0.156821 Nov 02 14:46:44.937967 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 398/775] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:46:44 2022] GET /compute/v2.1/servers/015a2580-2374-494d-a62d-8ea86c25b6d4 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:46:45.961191 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-6da921ad-e687-4c1f-a7b0-6b1277aab0eb tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:45.961863 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-6da921ad-e687-4c1f-a7b0-6b1277aab0eb tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 015a2580-2374-494d-a62d-8ea86c25b6d4] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:45.968927 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6da921ad-e687-4c1f-a7b0-6b1277aab0eb tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:45.969452 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6da921ad-e687-4c1f-a7b0-6b1277aab0eb tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:45.969896 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6da921ad-e687-4c1f-a7b0-6b1277aab0eb tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:45.970598 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6da921ad-e687-4c1f-a7b0-6b1277aab0eb tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:45.971057 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6da921ad-e687-4c1f-a7b0-6b1277aab0eb tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:45.971487 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6da921ad-e687-4c1f-a7b0-6b1277aab0eb tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:46.104569 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-6da921ad-e687-4c1f-a7b0-6b1277aab0eb tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:46.113297 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-6da921ad-e687-4c1f-a7b0-6b1277aab0eb tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/015a2580-2374-494d-a62d-8ea86c25b6d4" status: 200 len: 1367 microversion: 2.1 time: 0.156106 Nov 02 14:46:46.113869 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 378/776] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:46:45 2022] GET /compute/v2.1/servers/015a2580-2374-494d-a62d-8ea86c25b6d4 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:46:47.137292 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-9131d2b8-53cb-4302-a811-c4bd808bac1b tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:47.137905 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-9131d2b8-53cb-4302-a811-c4bd808bac1b tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 015a2580-2374-494d-a62d-8ea86c25b6d4] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:47.144172 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9131d2b8-53cb-4302-a811-c4bd808bac1b tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:47.144647 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9131d2b8-53cb-4302-a811-c4bd808bac1b tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:47.145113 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9131d2b8-53cb-4302-a811-c4bd808bac1b tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:47.145821 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9131d2b8-53cb-4302-a811-c4bd808bac1b tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:47.146273 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9131d2b8-53cb-4302-a811-c4bd808bac1b tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:47.146707 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9131d2b8-53cb-4302-a811-c4bd808bac1b tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:47.284554 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-9131d2b8-53cb-4302-a811-c4bd808bac1b tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:47.292318 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-9131d2b8-53cb-4302-a811-c4bd808bac1b tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/015a2580-2374-494d-a62d-8ea86c25b6d4" status: 200 len: 1367 microversion: 2.1 time: 0.159153 Nov 02 14:46:47.293469 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 399/777] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:46:47 2022] GET /compute/v2.1/servers/015a2580-2374-494d-a62d-8ea86c25b6d4 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:46:48.315851 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-48b65c9c-6920-4f01-a695-ff8a060474c2 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:48.316415 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-48b65c9c-6920-4f01-a695-ff8a060474c2 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 015a2580-2374-494d-a62d-8ea86c25b6d4] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:48.323100 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-48b65c9c-6920-4f01-a695-ff8a060474c2 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:48.323587 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-48b65c9c-6920-4f01-a695-ff8a060474c2 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:48.324145 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-48b65c9c-6920-4f01-a695-ff8a060474c2 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:48.325335 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-48b65c9c-6920-4f01-a695-ff8a060474c2 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:48.325794 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-48b65c9c-6920-4f01-a695-ff8a060474c2 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:48.326222 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-48b65c9c-6920-4f01-a695-ff8a060474c2 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:48.459910 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-48b65c9c-6920-4f01-a695-ff8a060474c2 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:48.468140 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-48b65c9c-6920-4f01-a695-ff8a060474c2 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/015a2580-2374-494d-a62d-8ea86c25b6d4" status: 200 len: 1367 microversion: 2.1 time: 0.156164 Nov 02 14:46:48.475793 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 379/778] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:46:48 2022] GET /compute/v2.1/servers/015a2580-2374-494d-a62d-8ea86c25b6d4 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:46:48.983926 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [req-4042b615-6f29-4765-ac74-4edcf839d3b6 req-0e8c8dd4-dcb4-4ca0-80be-bfb91fdca78c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "015a2580-2374-494d-a62d-8ea86c25b6d4", "name": "network-vif-plugged", "status": "completed", "tag": "1313078c-90cf-4898-bb7f-d746882578d0"}]} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:46:48.994210 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-4042b615-6f29-4765-ac74-4edcf839d3b6 req-0e8c8dd4-dcb4-4ca0-80be-bfb91fdca78c service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:48.994674 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-4042b615-6f29-4765-ac74-4edcf839d3b6 req-0e8c8dd4-dcb4-4ca0-80be-bfb91fdca78c service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:48.995100 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-4042b615-6f29-4765-ac74-4edcf839d3b6 req-0e8c8dd4-dcb4-4ca0-80be-bfb91fdca78c service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:49.006308 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.compute.server_external_events [req-4042b615-6f29-4765-ac74-4edcf839d3b6 req-0e8c8dd4-dcb4-4ca0-80be-bfb91fdca78c service nova] Creating event network-vif-plugged:1313078c-90cf-4898-bb7f-d746882578d0 for instance 015a2580-2374-494d-a62d-8ea86c25b6d4 on hv-cinder-86236 Nov 02 14:46:49.011418 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [req-4042b615-6f29-4765-ac74-4edcf839d3b6 req-0e8c8dd4-dcb4-4ca0-80be-bfb91fdca78c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031797 Nov 02 14:46:49.012457 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 400/779] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:46:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:46:49.490717 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-b6d293b3-befc-4367-9a3a-e47b0f6d936f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:49.491347 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-b6d293b3-befc-4367-9a3a-e47b0f6d936f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 015a2580-2374-494d-a62d-8ea86c25b6d4] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:49.493600 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell0:SELECT=2 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:46:49.494677 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell0:SELECT=6 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:46:49.500359 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b6d293b3-befc-4367-9a3a-e47b0f6d936f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:49.505781 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b6d293b3-befc-4367-9a3a-e47b0f6d936f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:49.505781 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b6d293b3-befc-4367-9a3a-e47b0f6d936f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:49.505781 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b6d293b3-befc-4367-9a3a-e47b0f6d936f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:49.505781 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b6d293b3-befc-4367-9a3a-e47b0f6d936f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:49.506168 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b6d293b3-befc-4367-9a3a-e47b0f6d936f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:49.641065 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-b6d293b3-befc-4367-9a3a-e47b0f6d936f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:49.648810 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-b6d293b3-befc-4367-9a3a-e47b0f6d936f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/015a2580-2374-494d-a62d-8ea86c25b6d4" status: 200 len: 1367 microversion: 2.1 time: 0.162377 Nov 02 14:46:49.649401 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 380/780] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:46:49 2022] GET /compute/v2.1/servers/015a2580-2374-494d-a62d-8ea86c25b6d4 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:46:50.672752 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-8e3b30a3-ace6-4411-9dd2-469eb5b4a7b6 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:50.673482 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-8e3b30a3-ace6-4411-9dd2-469eb5b4a7b6 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 015a2580-2374-494d-a62d-8ea86c25b6d4] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:50.677144 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell0:SELECT=6 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:46:50.681266 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8e3b30a3-ace6-4411-9dd2-469eb5b4a7b6 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:50.686719 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8e3b30a3-ace6-4411-9dd2-469eb5b4a7b6 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:50.686719 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8e3b30a3-ace6-4411-9dd2-469eb5b4a7b6 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:50.686719 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8e3b30a3-ace6-4411-9dd2-469eb5b4a7b6 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:50.686719 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8e3b30a3-ace6-4411-9dd2-469eb5b4a7b6 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:50.687259 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8e3b30a3-ace6-4411-9dd2-469eb5b4a7b6 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:50.814338 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-8e3b30a3-ace6-4411-9dd2-469eb5b4a7b6 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:50.822186 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-8e3b30a3-ace6-4411-9dd2-469eb5b4a7b6 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/015a2580-2374-494d-a62d-8ea86c25b6d4" status: 200 len: 1556 microversion: 2.1 time: 0.153884 Nov 02 14:46:50.822761 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 401/781] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:46:50 2022] GET /compute/v2.1/servers/015a2580-2374-494d-a62d-8ea86c25b6d4 => generated 1556 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:46:50.845706 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-54d7e903-bcc6-42a2-a90c-93e30094d5cb tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:50.846249 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-54d7e903-bcc6-42a2-a90c-93e30094d5cb tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 015a2580-2374-494d-a62d-8ea86c25b6d4] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:50.852786 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-54d7e903-bcc6-42a2-a90c-93e30094d5cb tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:50.853318 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-54d7e903-bcc6-42a2-a90c-93e30094d5cb tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:50.853758 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-54d7e903-bcc6-42a2-a90c-93e30094d5cb tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:50.854455 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-54d7e903-bcc6-42a2-a90c-93e30094d5cb tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:50.854907 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-54d7e903-bcc6-42a2-a90c-93e30094d5cb tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:50.856066 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-54d7e903-bcc6-42a2-a90c-93e30094d5cb tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:50.940653 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-54d7e903-bcc6-42a2-a90c-93e30094d5cb tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/015a2580-2374-494d-a62d-8ea86c25b6d4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099681 Nov 02 14:46:50.941297 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 381/782] 10.222.0.30 () {58 vars in 1275 bytes} [Wed Nov 2 14:46:50 2022] GET /compute/v2.1/servers/015a2580-2374-494d-a62d-8ea86c25b6d4/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:46:52.244610 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [req-03e3d365-706e-4a32-9fdd-4a816fd57d45 req-92b80fe2-6c47-40e4-9560-1bd5b967d885 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "015a2580-2374-494d-a62d-8ea86c25b6d4", "tag": "1313078c-90cf-4898-bb7f-d746882578d0"}]} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:46:52.254505 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-03e3d365-706e-4a32-9fdd-4a816fd57d45 req-92b80fe2-6c47-40e4-9560-1bd5b967d885 service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:52.255059 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-03e3d365-706e-4a32-9fdd-4a816fd57d45 req-92b80fe2-6c47-40e4-9560-1bd5b967d885 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:52.255521 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-03e3d365-706e-4a32-9fdd-4a816fd57d45 req-92b80fe2-6c47-40e4-9560-1bd5b967d885 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:52.267419 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.compute.server_external_events [req-03e3d365-706e-4a32-9fdd-4a816fd57d45 req-92b80fe2-6c47-40e4-9560-1bd5b967d885 service nova] Creating event network-changed:1313078c-90cf-4898-bb7f-d746882578d0 for instance 015a2580-2374-494d-a62d-8ea86c25b6d4 on hv-cinder-86236 Nov 02 14:46:52.272554 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [req-03e3d365-706e-4a32-9fdd-4a816fd57d45 req-92b80fe2-6c47-40e4-9560-1bd5b967d885 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031497 Nov 02 14:46:52.273396 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 402/783] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:46:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:47:06.278906 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:47:06.279592 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell1:SELECT=59 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:47:06.283890 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-f4e8ff92-5a29-4dbc-af37-78aa961df3d5 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:06.284389 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-f4e8ff92-5a29-4dbc-af37-78aa961df3d5 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:06.290940 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f4e8ff92-5a29-4dbc-af37-78aa961df3d5 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:06.297074 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f4e8ff92-5a29-4dbc-af37-78aa961df3d5 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:06.297074 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f4e8ff92-5a29-4dbc-af37-78aa961df3d5 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:06.297074 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f4e8ff92-5a29-4dbc-af37-78aa961df3d5 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:06.297074 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f4e8ff92-5a29-4dbc-af37-78aa961df3d5 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:06.297474 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f4e8ff92-5a29-4dbc-af37-78aa961df3d5 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:06.375755 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.objects.instance [None req-f4e8ff92-5a29-4dbc-af37-78aa961df3d5 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lazy-loading 'services' on Instance uuid 9dff2e06-ddf6-4c7a-8887-40092f0f9290 {{(pid=119658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:47:06.652557 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-f4e8ff92-5a29-4dbc-af37-78aa961df3d5 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290/os-volume_attachments/eac7df99-29d5-4a62-a7a7-2e6f6ddb2c99" status: 202 len: 0 microversion: 2.1 time: 0.374954 Nov 02 14:47:06.653245 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 382/784] 10.222.0.30 () {58 vars in 1416 bytes} [Wed Nov 2 14:47:06 2022] DELETE /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290/os-volume_attachments/eac7df99-29d5-4a62-a7a7-2e6f6ddb2c99 => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:47:08.834225 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_api:SELECT=17 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:47:08.835039 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:47:08.839111 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-167ae505-0c82-4d0c-8ce0-b352524631f1 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:47:08.844974 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-167ae505-0c82-4d0c-8ce0-b352524631f1 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:08.845470 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-167ae505-0c82-4d0c-8ce0-b352524631f1 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:08.845897 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-167ae505-0c82-4d0c-8ce0-b352524631f1 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:08.868707 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-167ae505-0c82-4d0c-8ce0-b352524631f1 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Going to try to stop instance {{(pid=119659) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 14:47:09.043947 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-167ae505-0c82-4d0c-8ce0-b352524631f1 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "POST /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290/action" status: 202 len: 0 microversion: 2.1 time: 0.210897 Nov 02 14:47:09.044470 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 403/785] 10.222.0.30 () {60 vars in 1278 bytes} [Wed Nov 2 14:47:08 2022] POST /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:47:09.053117 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-5c02014e-bb56-4f6e-9c67-ade59dcbb1e4 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:09.055570 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-5c02014e-bb56-4f6e-9c67-ade59dcbb1e4 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:09.060556 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5c02014e-bb56-4f6e-9c67-ade59dcbb1e4 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:09.061082 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5c02014e-bb56-4f6e-9c67-ade59dcbb1e4 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:09.061526 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5c02014e-bb56-4f6e-9c67-ade59dcbb1e4 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:09.062219 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5c02014e-bb56-4f6e-9c67-ade59dcbb1e4 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:09.062669 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5c02014e-bb56-4f6e-9c67-ade59dcbb1e4 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:09.063094 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5c02014e-bb56-4f6e-9c67-ade59dcbb1e4 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:09.196858 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-5c02014e-bb56-4f6e-9c67-ade59dcbb1e4 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:09.204840 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-5c02014e-bb56-4f6e-9c67-ade59dcbb1e4 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290" status: 200 len: 1677 microversion: 2.1 time: 0.156024 Nov 02 14:47:09.205444 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 383/786] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:09 2022] GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:47:10.231289 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-b94d571c-df1b-4f9c-b666-02e542b0700a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:10.231892 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-b94d571c-df1b-4f9c-b666-02e542b0700a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:10.238554 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b94d571c-df1b-4f9c-b666-02e542b0700a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:10.239059 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b94d571c-df1b-4f9c-b666-02e542b0700a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:10.239490 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b94d571c-df1b-4f9c-b666-02e542b0700a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:10.240167 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b94d571c-df1b-4f9c-b666-02e542b0700a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:10.241153 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b94d571c-df1b-4f9c-b666-02e542b0700a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:10.241521 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b94d571c-df1b-4f9c-b666-02e542b0700a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:10.373637 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-b94d571c-df1b-4f9c-b666-02e542b0700a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:10.381861 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-b94d571c-df1b-4f9c-b666-02e542b0700a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290" status: 200 len: 1677 microversion: 2.1 time: 0.155813 Nov 02 14:47:10.382576 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 404/787] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:10 2022] GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:47:11.405895 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-0e33d854-30db-461b-87b6-983fc571e102 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:11.406502 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-0e33d854-30db-461b-87b6-983fc571e102 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:11.413103 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0e33d854-30db-461b-87b6-983fc571e102 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:11.413592 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0e33d854-30db-461b-87b6-983fc571e102 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:11.414031 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0e33d854-30db-461b-87b6-983fc571e102 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:11.414723 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0e33d854-30db-461b-87b6-983fc571e102 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:11.415177 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0e33d854-30db-461b-87b6-983fc571e102 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:11.415601 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0e33d854-30db-461b-87b6-983fc571e102 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:11.548524 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-0e33d854-30db-461b-87b6-983fc571e102 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:11.556834 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-0e33d854-30db-461b-87b6-983fc571e102 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290" status: 200 len: 1677 microversion: 2.1 time: 0.154860 Nov 02 14:47:11.557423 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 384/788] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:11 2022] GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:12.580810 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-0bc1bcfc-2112-423e-9f89-add340dfd998 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:12.581472 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-0bc1bcfc-2112-423e-9f89-add340dfd998 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:12.588548 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0bc1bcfc-2112-423e-9f89-add340dfd998 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:12.589042 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0bc1bcfc-2112-423e-9f89-add340dfd998 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:12.589525 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0bc1bcfc-2112-423e-9f89-add340dfd998 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:12.595610 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0bc1bcfc-2112-423e-9f89-add340dfd998 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:12.595610 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0bc1bcfc-2112-423e-9f89-add340dfd998 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:12.595610 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0bc1bcfc-2112-423e-9f89-add340dfd998 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:12.722301 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-0bc1bcfc-2112-423e-9f89-add340dfd998 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:12.730361 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-0bc1bcfc-2112-423e-9f89-add340dfd998 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290" status: 200 len: 1677 microversion: 2.1 time: 0.153419 Nov 02 14:47:12.730968 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 405/789] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:12 2022] GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:13.754179 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-6b6d3a25-efd8-4083-af9e-688bd350482c tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:13.754790 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-6b6d3a25-efd8-4083-af9e-688bd350482c tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:13.762125 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6b6d3a25-efd8-4083-af9e-688bd350482c tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:13.762613 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6b6d3a25-efd8-4083-af9e-688bd350482c tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:13.763054 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6b6d3a25-efd8-4083-af9e-688bd350482c tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:13.763748 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6b6d3a25-efd8-4083-af9e-688bd350482c tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:13.764200 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6b6d3a25-efd8-4083-af9e-688bd350482c tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:13.764634 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6b6d3a25-efd8-4083-af9e-688bd350482c tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:13.891159 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-6b6d3a25-efd8-4083-af9e-688bd350482c tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:13.899152 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-6b6d3a25-efd8-4083-af9e-688bd350482c tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290" status: 200 len: 1677 microversion: 2.1 time: 0.148590 Nov 02 14:47:13.899816 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 385/790] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:13 2022] GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:14.923621 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-938daa9b-85fe-4c14-8274-81462e549069 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:14.924298 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-938daa9b-85fe-4c14-8274-81462e549069 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:14.930752 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-938daa9b-85fe-4c14-8274-81462e549069 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:14.931229 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-938daa9b-85fe-4c14-8274-81462e549069 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:14.931694 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-938daa9b-85fe-4c14-8274-81462e549069 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:14.932428 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-938daa9b-85fe-4c14-8274-81462e549069 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:14.932880 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-938daa9b-85fe-4c14-8274-81462e549069 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:14.933330 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-938daa9b-85fe-4c14-8274-81462e549069 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:15.061389 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-938daa9b-85fe-4c14-8274-81462e549069 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:15.069641 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-938daa9b-85fe-4c14-8274-81462e549069 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290" status: 200 len: 1677 microversion: 2.1 time: 0.149981 Nov 02 14:47:15.070219 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 406/791] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:14 2022] GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:16.093218 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-b78873be-907a-4fe8-b190-c77cdee02ab9 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:16.093754 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-b78873be-907a-4fe8-b190-c77cdee02ab9 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:16.100034 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b78873be-907a-4fe8-b190-c77cdee02ab9 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:16.100515 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b78873be-907a-4fe8-b190-c77cdee02ab9 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:16.101036 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b78873be-907a-4fe8-b190-c77cdee02ab9 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:16.101668 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b78873be-907a-4fe8-b190-c77cdee02ab9 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:16.102115 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b78873be-907a-4fe8-b190-c77cdee02ab9 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:16.102540 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b78873be-907a-4fe8-b190-c77cdee02ab9 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:16.231530 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-b78873be-907a-4fe8-b190-c77cdee02ab9 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:16.239293 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-b78873be-907a-4fe8-b190-c77cdee02ab9 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290" status: 200 len: 1677 microversion: 2.1 time: 0.150165 Nov 02 14:47:16.239857 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 386/792] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:16 2022] GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:17.262910 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-2854df66-ada2-4583-b493-aa664641356c tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:17.263511 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-2854df66-ada2-4583-b493-aa664641356c tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:17.269616 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2854df66-ada2-4583-b493-aa664641356c tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:17.270084 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2854df66-ada2-4583-b493-aa664641356c tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:17.270514 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2854df66-ada2-4583-b493-aa664641356c tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:17.271187 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2854df66-ada2-4583-b493-aa664641356c tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:17.271634 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2854df66-ada2-4583-b493-aa664641356c tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:17.272606 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2854df66-ada2-4583-b493-aa664641356c tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:17.399975 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-2854df66-ada2-4583-b493-aa664641356c tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:17.407911 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-2854df66-ada2-4583-b493-aa664641356c tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290" status: 200 len: 1677 microversion: 2.1 time: 0.148830 Nov 02 14:47:17.408414 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 407/793] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:17 2022] GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:18.432551 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-e772b4b9-f8c7-4089-b752-6347d6393c11 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:18.433192 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-e772b4b9-f8c7-4089-b752-6347d6393c11 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:18.439668 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e772b4b9-f8c7-4089-b752-6347d6393c11 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:18.440185 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e772b4b9-f8c7-4089-b752-6347d6393c11 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:18.440619 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e772b4b9-f8c7-4089-b752-6347d6393c11 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:18.441353 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e772b4b9-f8c7-4089-b752-6347d6393c11 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:18.441799 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e772b4b9-f8c7-4089-b752-6347d6393c11 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:18.442220 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e772b4b9-f8c7-4089-b752-6347d6393c11 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:18.574458 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-e772b4b9-f8c7-4089-b752-6347d6393c11 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:18.582218 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-e772b4b9-f8c7-4089-b752-6347d6393c11 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290" status: 200 len: 1677 microversion: 2.1 time: 0.154088 Nov 02 14:47:18.582786 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 387/794] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:18 2022] GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:19.606457 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-8bf13986-9e50-46a9-a9f7-2596b68f46f0 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:19.607088 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-8bf13986-9e50-46a9-a9f7-2596b68f46f0 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:19.613525 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8bf13986-9e50-46a9-a9f7-2596b68f46f0 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:19.613992 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8bf13986-9e50-46a9-a9f7-2596b68f46f0 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:19.614448 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8bf13986-9e50-46a9-a9f7-2596b68f46f0 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:19.615144 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8bf13986-9e50-46a9-a9f7-2596b68f46f0 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:19.615916 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8bf13986-9e50-46a9-a9f7-2596b68f46f0 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:19.616344 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8bf13986-9e50-46a9-a9f7-2596b68f46f0 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:19.749614 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-8bf13986-9e50-46a9-a9f7-2596b68f46f0 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:19.757259 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-8bf13986-9e50-46a9-a9f7-2596b68f46f0 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290" status: 200 len: 1677 microversion: 2.1 time: 0.155339 Nov 02 14:47:19.757841 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 408/795] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:19 2022] GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:20.780770 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-61f9d339-f2ce-41fc-a9d4-df94dd109f7a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:20.781419 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-61f9d339-f2ce-41fc-a9d4-df94dd109f7a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:20.787964 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-61f9d339-f2ce-41fc-a9d4-df94dd109f7a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:20.788445 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-61f9d339-f2ce-41fc-a9d4-df94dd109f7a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:20.789438 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-61f9d339-f2ce-41fc-a9d4-df94dd109f7a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:20.790313 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-61f9d339-f2ce-41fc-a9d4-df94dd109f7a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:20.790779 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-61f9d339-f2ce-41fc-a9d4-df94dd109f7a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:20.791209 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-61f9d339-f2ce-41fc-a9d4-df94dd109f7a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:20.919306 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-61f9d339-f2ce-41fc-a9d4-df94dd109f7a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:20.927114 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-61f9d339-f2ce-41fc-a9d4-df94dd109f7a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290" status: 200 len: 1654 microversion: 2.1 time: 0.150303 Nov 02 14:47:20.927673 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 388/796] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:20 2022] GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290 => generated 1654 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:20.950075 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-5f0a7cc7-fae9-491b-b10b-e298a11169a9 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:47:20.956423 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5f0a7cc7-fae9-491b-b10b-e298a11169a9 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:20.956935 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5f0a7cc7-fae9-491b-b10b-e298a11169a9 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:20.957403 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5f0a7cc7-fae9-491b-b10b-e298a11169a9 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:20.980421 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-5f0a7cc7-fae9-491b-b10b-e298a11169a9 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Going to try to start instance {{(pid=119659) start /opt/stack/nova/nova/compute/api.py:2785}} Nov 02 14:47:21.195209 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-5f0a7cc7-fae9-491b-b10b-e298a11169a9 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "POST /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290/action" status: 202 len: 0 microversion: 2.1 time: 0.248854 Nov 02 14:47:21.196211 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 409/797] 10.222.0.30 () {60 vars in 1278 bytes} [Wed Nov 2 14:47:20 2022] POST /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:47:21.204209 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-ea43368a-4cce-4b11-9b9d-ed8bef764514 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:21.204751 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-ea43368a-4cce-4b11-9b9d-ed8bef764514 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:21.210631 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ea43368a-4cce-4b11-9b9d-ed8bef764514 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:21.211614 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ea43368a-4cce-4b11-9b9d-ed8bef764514 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:21.212050 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ea43368a-4cce-4b11-9b9d-ed8bef764514 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:21.212753 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ea43368a-4cce-4b11-9b9d-ed8bef764514 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:21.213243 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ea43368a-4cce-4b11-9b9d-ed8bef764514 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:21.213669 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ea43368a-4cce-4b11-9b9d-ed8bef764514 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:21.351089 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-ea43368a-4cce-4b11-9b9d-ed8bef764514 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:21.359314 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-ea43368a-4cce-4b11-9b9d-ed8bef764514 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290" status: 200 len: 1663 microversion: 2.1 time: 0.158991 Nov 02 14:47:21.359935 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 389/798] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:21 2022] GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290 => generated 1663 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:22.385120 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-27702342-13bd-4844-8ebf-0e5f61caf0d8 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:22.385828 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-27702342-13bd-4844-8ebf-0e5f61caf0d8 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:22.391995 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-27702342-13bd-4844-8ebf-0e5f61caf0d8 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:22.392475 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-27702342-13bd-4844-8ebf-0e5f61caf0d8 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:22.392913 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-27702342-13bd-4844-8ebf-0e5f61caf0d8 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:22.393633 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-27702342-13bd-4844-8ebf-0e5f61caf0d8 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:22.394086 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-27702342-13bd-4844-8ebf-0e5f61caf0d8 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:22.394514 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-27702342-13bd-4844-8ebf-0e5f61caf0d8 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:22.527753 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-27702342-13bd-4844-8ebf-0e5f61caf0d8 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:22.535542 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-27702342-13bd-4844-8ebf-0e5f61caf0d8 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290" status: 200 len: 1663 microversion: 2.1 time: 0.156196 Nov 02 14:47:22.536101 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 410/799] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:22 2022] GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290 => generated 1663 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:23.559179 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-6a8be491-de7f-4e16-81ab-9bd66fc37a62 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:23.559847 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-6a8be491-de7f-4e16-81ab-9bd66fc37a62 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:23.566312 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6a8be491-de7f-4e16-81ab-9bd66fc37a62 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:23.566789 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6a8be491-de7f-4e16-81ab-9bd66fc37a62 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:23.567220 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6a8be491-de7f-4e16-81ab-9bd66fc37a62 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:23.567900 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6a8be491-de7f-4e16-81ab-9bd66fc37a62 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:23.568350 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6a8be491-de7f-4e16-81ab-9bd66fc37a62 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:23.568771 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6a8be491-de7f-4e16-81ab-9bd66fc37a62 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:23.700922 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-6a8be491-de7f-4e16-81ab-9bd66fc37a62 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:23.708630 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-6a8be491-de7f-4e16-81ab-9bd66fc37a62 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290" status: 200 len: 1667 microversion: 2.1 time: 0.153325 Nov 02 14:47:23.709219 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 390/800] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:23 2022] GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290 => generated 1667 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:28.368710 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-a318cd19-3d14-4938-8d4c-6e5d954419c3 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:28.369934 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-a318cd19-3d14-4938-8d4c-6e5d954419c3 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 015a2580-2374-494d-a62d-8ea86c25b6d4] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:28.377396 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a318cd19-3d14-4938-8d4c-6e5d954419c3 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:28.377882 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a318cd19-3d14-4938-8d4c-6e5d954419c3 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:28.378318 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a318cd19-3d14-4938-8d4c-6e5d954419c3 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:28.379017 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a318cd19-3d14-4938-8d4c-6e5d954419c3 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:28.379460 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a318cd19-3d14-4938-8d4c-6e5d954419c3 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:28.379877 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a318cd19-3d14-4938-8d4c-6e5d954419c3 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:28.404717 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-a318cd19-3d14-4938-8d4c-6e5d954419c3 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/015a2580-2374-494d-a62d-8ea86c25b6d4/ips" status: 200 len: 148 microversion: 2.1 time: 0.040279 Nov 02 14:47:28.405580 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 411/801] 10.222.0.30 () {58 vars in 1248 bytes} [Wed Nov 2 14:47:28 2022] GET /compute/v2.1/servers/015a2580-2374-494d-a62d-8ea86c25b6d4/ips => generated 148 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:47:30.554910 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-cba88837-305f-44b0-b0b5-7571ec846155 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6aa621aa-eb80-42f5-b4b5-9761efc1367d"}} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:47:30.557371 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-cba88837-305f-44b0-b0b5-7571ec846155 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 015a2580-2374-494d-a62d-8ea86c25b6d4] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:30.564287 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-cba88837-305f-44b0-b0b5-7571ec846155 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:30.564800 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-cba88837-305f-44b0-b0b5-7571ec846155 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:30.565257 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-cba88837-305f-44b0-b0b5-7571ec846155 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:30.565950 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-cba88837-305f-44b0-b0b5-7571ec846155 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:30.566403 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-cba88837-305f-44b0-b0b5-7571ec846155 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:30.566826 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-cba88837-305f-44b0-b0b5-7571ec846155 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:31.390719 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-cba88837-305f-44b0-b0b5-7571ec846155 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "POST /compute/v2.1/servers/015a2580-2374-494d-a62d-8ea86c25b6d4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.839844 Nov 02 14:47:31.395419 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 391/802] 10.222.0.30 () {60 vars in 1323 bytes} [Wed Nov 2 14:47:30 2022] POST /compute/v2.1/servers/015a2580-2374-494d-a62d-8ea86c25b6d4/os-volume_attachments => generated 194 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:47:34.816006 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-b72c9345-ff2d-4f3c-bdb7-4ed9400a46a9 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:34.816603 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-b72c9345-ff2d-4f3c-bdb7-4ed9400a46a9 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: a70e0509-33cf-40a8-a0e2-a5da4317522c] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:34.824229 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b72c9345-ff2d-4f3c-bdb7-4ed9400a46a9 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:34.824704 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b72c9345-ff2d-4f3c-bdb7-4ed9400a46a9 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:34.825181 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b72c9345-ff2d-4f3c-bdb7-4ed9400a46a9 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:34.825931 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b72c9345-ff2d-4f3c-bdb7-4ed9400a46a9 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:34.826336 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b72c9345-ff2d-4f3c-bdb7-4ed9400a46a9 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:34.826761 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b72c9345-ff2d-4f3c-bdb7-4ed9400a46a9 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:34.851688 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-b72c9345-ff2d-4f3c-bdb7-4ed9400a46a9 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: a70e0509-33cf-40a8-a0e2-a5da4317522c] Going to try to terminate instance {{(pid=119659) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:47:35.180835 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-b72c9345-ff2d-4f3c-bdb7-4ed9400a46a9 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c" status: 204 len: 0 microversion: 2.1 time: 0.369013 Nov 02 14:47:35.181462 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 412/803] 10.222.0.30 () {58 vars in 1239 bytes} [Wed Nov 2 14:47:34 2022] DELETE /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:47:35.190805 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-c4f83555-6447-480b-930c-5aafe0da8c68 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:35.191494 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-c4f83555-6447-480b-930c-5aafe0da8c68 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: a70e0509-33cf-40a8-a0e2-a5da4317522c] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:35.198097 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c4f83555-6447-480b-930c-5aafe0da8c68 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:35.198576 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c4f83555-6447-480b-930c-5aafe0da8c68 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:35.199040 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c4f83555-6447-480b-930c-5aafe0da8c68 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:35.199723 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c4f83555-6447-480b-930c-5aafe0da8c68 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:35.200171 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c4f83555-6447-480b-930c-5aafe0da8c68 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:35.200590 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c4f83555-6447-480b-930c-5aafe0da8c68 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:35.339325 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-c4f83555-6447-480b-930c-5aafe0da8c68 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:35.347811 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-c4f83555-6447-480b-930c-5aafe0da8c68 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c" status: 200 len: 1576 microversion: 2.1 time: 0.161730 Nov 02 14:47:35.348412 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 392/804] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:35 2022] GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:36.372492 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-dff8dfe4-ab65-44cf-8b0d-689a7fa56221 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:36.373217 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-dff8dfe4-ab65-44cf-8b0d-689a7fa56221 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: a70e0509-33cf-40a8-a0e2-a5da4317522c] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:36.379571 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-dff8dfe4-ab65-44cf-8b0d-689a7fa56221 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:36.380058 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-dff8dfe4-ab65-44cf-8b0d-689a7fa56221 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:36.380491 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-dff8dfe4-ab65-44cf-8b0d-689a7fa56221 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:36.381213 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-dff8dfe4-ab65-44cf-8b0d-689a7fa56221 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:36.381718 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-dff8dfe4-ab65-44cf-8b0d-689a7fa56221 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:36.382141 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-dff8dfe4-ab65-44cf-8b0d-689a7fa56221 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:36.524774 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-dff8dfe4-ab65-44cf-8b0d-689a7fa56221 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:36.532805 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-dff8dfe4-ab65-44cf-8b0d-689a7fa56221 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c" status: 200 len: 1576 microversion: 2.1 time: 0.164551 Nov 02 14:47:36.533401 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 413/805] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:36 2022] GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:37.556353 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-d05ac949-841a-4b52-888d-6a0e953dcb28 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:37.557209 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-d05ac949-841a-4b52-888d-6a0e953dcb28 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: a70e0509-33cf-40a8-a0e2-a5da4317522c] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:37.560660 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_api:SELECT=23 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:47:37.564642 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d05ac949-841a-4b52-888d-6a0e953dcb28 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:37.565160 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d05ac949-841a-4b52-888d-6a0e953dcb28 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:37.565609 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d05ac949-841a-4b52-888d-6a0e953dcb28 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:37.566353 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d05ac949-841a-4b52-888d-6a0e953dcb28 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:37.566813 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d05ac949-841a-4b52-888d-6a0e953dcb28 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:37.567248 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d05ac949-841a-4b52-888d-6a0e953dcb28 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:37.570032 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell1:SELECT=75,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:47:37.818392 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-d05ac949-841a-4b52-888d-6a0e953dcb28 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:37.826463 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-d05ac949-841a-4b52-888d-6a0e953dcb28 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c" status: 200 len: 1576 microversion: 2.1 time: 0.273882 Nov 02 14:47:37.827178 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 393/806] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:37 2022] GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c => generated 1576 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:38.008962 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [req-0afd50b1-7bda-4ae1-bc92-6c6a99b07a64 req-b412a12c-a6cb-402a-a5ae-94d9e6dfc58b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a70e0509-33cf-40a8-a0e2-a5da4317522c", "name": "network-vif-deleted", "tag": "31597016-abf2-4436-a570-4e0d25351888"}]} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:47:38.038536 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-0afd50b1-7bda-4ae1-bc92-6c6a99b07a64 req-b412a12c-a6cb-402a-a5ae-94d9e6dfc58b service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:38.039029 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-0afd50b1-7bda-4ae1-bc92-6c6a99b07a64 req-b412a12c-a6cb-402a-a5ae-94d9e6dfc58b service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:38.039662 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-0afd50b1-7bda-4ae1-bc92-6c6a99b07a64 req-b412a12c-a6cb-402a-a5ae-94d9e6dfc58b service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:38.053581 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.compute.server_external_events [req-0afd50b1-7bda-4ae1-bc92-6c6a99b07a64 req-b412a12c-a6cb-402a-a5ae-94d9e6dfc58b service nova] Creating event network-vif-deleted:31597016-abf2-4436-a570-4e0d25351888 for instance a70e0509-33cf-40a8-a0e2-a5da4317522c on hv-cinder-86236 Nov 02 14:47:38.060057 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [req-0afd50b1-7bda-4ae1-bc92-6c6a99b07a64 req-b412a12c-a6cb-402a-a5ae-94d9e6dfc58b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055647 Nov 02 14:47:38.062009 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 414/807] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:47:38.855332 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-605f1674-0779-4e40-9f09-88d9797f3f91 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:38.857225 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-605f1674-0779-4e40-9f09-88d9797f3f91 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: a70e0509-33cf-40a8-a0e2-a5da4317522c] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:38.878411 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-605f1674-0779-4e40-9f09-88d9797f3f91 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:38.878411 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-605f1674-0779-4e40-9f09-88d9797f3f91 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:38.878411 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-605f1674-0779-4e40-9f09-88d9797f3f91 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:38.878411 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-605f1674-0779-4e40-9f09-88d9797f3f91 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:38.879049 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-605f1674-0779-4e40-9f09-88d9797f3f91 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:38.879416 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-605f1674-0779-4e40-9f09-88d9797f3f91 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:38.955469 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-605f1674-0779-4e40-9f09-88d9797f3f91 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:38.966631 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-605f1674-0779-4e40-9f09-88d9797f3f91 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c" status: 200 len: 1224 microversion: 2.1 time: 0.118760 Nov 02 14:47:38.967217 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 394/808] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:38 2022] GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c => generated 1224 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:39.992234 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-ae027968-7041-48d5-b820-d964eba5d7a2 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:39.992925 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-ae027968-7041-48d5-b820-d964eba5d7a2 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: a70e0509-33cf-40a8-a0e2-a5da4317522c] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:39.994907 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:47:40.000090 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ae027968-7041-48d5-b820-d964eba5d7a2 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:40.000613 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ae027968-7041-48d5-b820-d964eba5d7a2 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:40.001100 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ae027968-7041-48d5-b820-d964eba5d7a2 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:40.003919 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ae027968-7041-48d5-b820-d964eba5d7a2 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:40.003919 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ae027968-7041-48d5-b820-d964eba5d7a2 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:40.003919 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ae027968-7041-48d5-b820-d964eba5d7a2 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:40.016816 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.wsgi [None req-ae027968-7041-48d5-b820-d964eba5d7a2 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] HTTP exception thrown: Instance a70e0509-33cf-40a8-a0e2-a5da4317522c could not be found. Nov 02 14:47:40.018523 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-ae027968-7041-48d5-b820-d964eba5d7a2 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Request method failure captured: Nov 02 14:47:40.018523 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: request: GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c HTTP/1.1 Nov 02 14:47:40.018523 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Accept: application/json Nov 02 14:47:40.018523 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Accept-Encoding: identity Nov 02 14:47:40.018523 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Connection: close Nov 02 14:47:40.018523 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Content-Length: 0 Nov 02 14:47:40.018523 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Content-Type: application/json Nov 02 14:47:40.018523 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Host: 10.222.0.30 Nov 02 14:47:40.018523 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Openstack-System-Scope: None Nov 02 14:47:40.018523 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: User-Agent: python-urllib3/1.26.12 Nov 02 14:47:40.018523 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Auth-Token: gAAAAABjYoJU8mRtfklw2BqB8rxFPb9k4q0WLzod3pzKmTOxEu-Rawboc6-18-tFhoQU0IBY1PalXTbgXqEb5svZEk4EM19nsBvNwEJ9rKdAGE2eZMXT00nXhJe0Nq67h_qpM4Csttau-wzu2afBMob496zDR_AX_Vw_7hryB10KQXmXtCuC5P8 Nov 02 14:47:40.018523 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Domain-Id: None Nov 02 14:47:40.018523 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Domain-Name: None Nov 02 14:47:40.018523 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Identity-Status: Confirmed Nov 02 14:47:40.018523 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Is-Admin-Project: True Nov 02 14:47:40.018523 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Domain-Id: default Nov 02 14:47:40.018523 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Domain-Name: Default Nov 02 14:47:40.018523 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Id: 990b7e753ad1450489668d0ca151736e Nov 02 14:47:40.018523 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Name: tempest-TestVolumeBootPattern-1105129780 Nov 02 14:47:40.018523 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Role: reader,member Nov 02 14:47:40.018523 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Roles: reader,member Nov 02 14:47:40.020220 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/990b7e753ad1450489668d0ca151736e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/990b7e753ad1450489668d0ca151736e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/990b7e753ad1450489668d0ca151736e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_990b7e753ad1450489668d0ca151736e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:47:40.020220 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant: tempest-TestVolumeBootPattern-1105129780 Nov 02 14:47:40.020220 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant-Id: 990b7e753ad1450489668d0ca151736e Nov 02 14:47:40.020220 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant-Name: tempest-TestVolumeBootPattern-1105129780 Nov 02 14:47:40.020220 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User: tempest-TestVolumeBootPattern-1105129780-project Nov 02 14:47:40.020220 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Domain-Id: default Nov 02 14:47:40.020220 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Domain-Name: Default Nov 02 14:47:40.020220 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Id: 6f0516ac4c6648f9b208a89e174da3a3 Nov 02 14:47:40.020220 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Name: tempest-TestVolumeBootPattern-1105129780-project Nov 02 14:47:40.020220 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: method: > Nov 02 14:47:40.020220 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: exception: Instance a70e0509-33cf-40a8-a0e2-a5da4317522c could not be found. Nov 02 14:47:40.020220 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: action_args: {'id': 'a70e0509-33cf-40a8-a0e2-a5da4317522c'} Nov 02 14:47:40.021252 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:47:40.021252 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:47:40.021252 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:47:40.021252 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:47:40.021252 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:47:40.021252 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:47:40.021252 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:47:40.021252 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:47:40.021252 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:47:40.021252 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:47:40.021252 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a70e0509-33cf-40a8-a0e2-a5da4317522c could not be found. Nov 02 14:47:40.021252 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:47:40.021252 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:47:40.021252 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:47:40.021252 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:47:40.021252 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:47:40.021252 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:47:40.021252 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:47:40.021252 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:47:40.021252 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:47:40.022795 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:47:40.022795 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:47:40.022795 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:47:40.022795 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:47:40.022795 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:47:40.022795 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:47:40.022795 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:47:40.022795 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a70e0509-33cf-40a8-a0e2-a5da4317522c could not be found. Nov 02 14:47:40.022795 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:47:40.022795 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:47:40.022795 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:47:40.022795 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:47:40.022795 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:47:40.022795 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:47:40.022795 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:47:40.022795 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:47:40.022795 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a70e0509-33cf-40a8-a0e2-a5da4317522c could not be found. Nov 02 14:47:40.022795 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:47:40.024206 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-ae027968-7041-48d5-b820-d964eba5d7a2 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Returning 404 to user: Instance a70e0509-33cf-40a8-a0e2-a5da4317522c could not be found. {{(pid=119659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:47:40.024206 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-ae027968-7041-48d5-b820-d964eba5d7a2 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c" status: 404 len: 111 microversion: 2.1 time: 0.032790 Nov 02 14:47:40.024543 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 415/809] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:39 2022] GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:47:40.025362 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-91bb08f6-5521-468e-9656-5f72decd3994 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Action: 'create', calling method: .version_select at 0x7fb24ecbfee0>, body: {"keypair": {"name": "tempest-keypair-1105590767", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDYtWT6btWP9MK48u5zdO+M+aCL7BLMdv//dQ2H2/WkluEAJIZFIRgE7ZzjDhK6lXG30moQb8Z3JU5U2UxHR03yeIWeOtTMxF7JTPz6wC4LWES9eEXM7F4hl3lylLTPc3g=="}} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:47:40.044008 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.quota [None req-91bb08f6-5521-468e-9656-5f72decd3994 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Getting quotas for project e428f318654f446db48445e4570ae2d3. Resources: {'key_pairs'} {{(pid=119658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:47:40.048795 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.quota [None req-91bb08f6-5521-468e-9656-5f72decd3994 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Getting quotas for user 7fa761a568644a9399d825498a51f054 and project e428f318654f446db48445e4570ae2d3. Resources: {'key_pairs'} {{(pid=119658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:47:40.143024 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-91bb08f6-5521-468e-9656-5f72decd3994 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.121307 Nov 02 14:47:40.143686 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 395/810] 10.222.0.30 () {60 vars in 1159 bytes} [Wed Nov 2 14:47:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:47:40.185612 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-1253de4d-3695-4111-9283-d0be958f4648 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2064447497", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-667872314", "security_groups": [{"name": "tempest-secgroup-smoke-744571343"}], "block_device_mapping_v2": [{"uuid": "438f680d-f3cd-4bc9-ade4-2be0195d65a3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3f9be41b-3ac6-43ae-b64c-2573362419af"}]}} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:47:40.338910 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.network.neutron [None req-1253de4d-3695-4111-9283-d0be958f4648 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] validate_networks() for [('3f9be41b-3ac6-43ae-b64c-2573362419af', None, None, None, None, None)] {{(pid=119659) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:47:40.788678 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.virt.hardware [None req-1253de4d-3695-4111-9283-d0be958f4648 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Flavor limits 0:0:0 {{(pid=119659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:47:40.789128 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.virt.hardware [None req-1253de4d-3695-4111-9283-d0be958f4648 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Image limits 0:0:0 {{(pid=119659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:47:40.789646 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.virt.hardware [None req-1253de4d-3695-4111-9283-d0be958f4648 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Flavor pref 0:0:0 {{(pid=119659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:47:40.790050 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.virt.hardware [None req-1253de4d-3695-4111-9283-d0be958f4648 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Image pref 0:0:0 {{(pid=119659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:47:40.790455 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.virt.hardware [None req-1253de4d-3695-4111-9283-d0be958f4648 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:47:40.800737 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1253de4d-3695-4111-9283-d0be958f4648 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:40.801291 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1253de4d-3695-4111-9283-d0be958f4648 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:40.801731 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1253de4d-3695-4111-9283-d0be958f4648 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:40.802469 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1253de4d-3695-4111-9283-d0be958f4648 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:40.802922 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1253de4d-3695-4111-9283-d0be958f4648 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:40.803351 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1253de4d-3695-4111-9283-d0be958f4648 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:40.810629 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:47:40.823204 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.quota [None req-1253de4d-3695-4111-9283-d0be958f4648 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Getting quotas for project 990b7e753ad1450489668d0ca151736e. Resources: {'instances', 'ram', 'cores'} {{(pid=119659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:47:40.827623 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.quota [None req-1253de4d-3695-4111-9283-d0be958f4648 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Getting quotas for user 6f0516ac4c6648f9b208a89e174da3a3 and project 990b7e753ad1450489668d0ca151736e. Resources: {'instances', 'ram', 'cores'} {{(pid=119659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:47:40.888577 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-1253de4d-3695-4111-9283-d0be958f4648 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Going to run 1 instances... {{(pid=119659) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:47:40.890960 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-1253de4d-3695-4111-9283-d0be958f4648 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: 6e4576f1-35ce-4081-a2f1-e8e324a1c677] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='438f680d-f3cd-4bc9-ade4-2be0195d65a3',volume_size=None,volume_type=None)] {{(pid=119659) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:47:41.366789 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1253de4d-3695-4111-9283-d0be958f4648 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [802bd307-ec6c-4681-a743-21355b880dfe] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 14:47:42.375934 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO oslo.messaging._drivers.impl_rabbit [None req-1253de4d-3695-4111-9283-d0be958f4648 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [802bd307-ec6c-4681-a743-21355b880dfe] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 37066. Nov 02 14:47:42.380539 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-1253de4d-3695-4111-9283-d0be958f4648 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.198764 Nov 02 14:47:42.381242 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 416/811] 10.222.0.30 () {60 vars in 1147 bytes} [Wed Nov 2 14:47:40 2022] POST /compute/v2.1/servers => generated 405 bytes in 2200 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:47:42.394877 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-ee16a299-9735-4569-847b-631ee60e1c0c tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:42.397737 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-ee16a299-9735-4569-847b-631ee60e1c0c tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: 6e4576f1-35ce-4081-a2f1-e8e324a1c677] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:42.459547 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-ee16a299-9735-4569-847b-631ee60e1c0c tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:42.470645 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-ee16a299-9735-4569-847b-631ee60e1c0c tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/6e4576f1-35ce-4081-a2f1-e8e324a1c677" status: 200 len: 1094 microversion: 2.1 time: 0.080235 Nov 02 14:47:42.471257 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 396/812] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:42 2022] GET /compute/v2.1/servers/6e4576f1-35ce-4081-a2f1-e8e324a1c677 => generated 1094 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:42.932606 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-cf83da0d-81f2-4367-a872-7189b2f4e149 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-310865543", "imageRef": "a726a246-cc7f-46e6-aeff-4d62e03cc091", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d6bf9a07-46e7-4c2d-8535-e65644e316a0"}], "security_groups": [{"name": "tempest-securitygroup--967303420"}], "key_name": "tempest-keypair-1105590767", "user_data": "}} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:47:43.045368 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.network.neutron [None req-cf83da0d-81f2-4367-a872-7189b2f4e149 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] validate_networks() for [('d6bf9a07-46e7-4c2d-8535-e65644e316a0', None, None, None, None, None)] {{(pid=119659) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:47:43.429668 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.virt.hardware [None req-cf83da0d-81f2-4367-a872-7189b2f4e149 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Flavor limits 0:0:0 {{(pid=119659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:47:43.430395 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.virt.hardware [None req-cf83da0d-81f2-4367-a872-7189b2f4e149 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Image limits 0:0:0 {{(pid=119659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:47:43.430644 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.virt.hardware [None req-cf83da0d-81f2-4367-a872-7189b2f4e149 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Flavor pref 0:0:0 {{(pid=119659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:47:43.431051 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.virt.hardware [None req-cf83da0d-81f2-4367-a872-7189b2f4e149 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Image pref 0:0:0 {{(pid=119659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:47:43.431458 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.virt.hardware [None req-cf83da0d-81f2-4367-a872-7189b2f4e149 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:47:43.441178 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-cf83da0d-81f2-4367-a872-7189b2f4e149 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:43.441816 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-cf83da0d-81f2-4367-a872-7189b2f4e149 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:43.442246 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-cf83da0d-81f2-4367-a872-7189b2f4e149 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:43.442976 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-cf83da0d-81f2-4367-a872-7189b2f4e149 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:43.443426 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-cf83da0d-81f2-4367-a872-7189b2f4e149 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:43.443848 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-cf83da0d-81f2-4367-a872-7189b2f4e149 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:43.461106 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.quota [None req-cf83da0d-81f2-4367-a872-7189b2f4e149 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Getting quotas for project e428f318654f446db48445e4570ae2d3. Resources: {'instances', 'ram', 'cores'} {{(pid=119659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:47:43.464870 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.quota [None req-cf83da0d-81f2-4367-a872-7189b2f4e149 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Getting quotas for user 7fa761a568644a9399d825498a51f054 and project e428f318654f446db48445e4570ae2d3. Resources: {'instances', 'ram', 'cores'} {{(pid=119659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:47:43.476931 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-cf83da0d-81f2-4367-a872-7189b2f4e149 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Going to run 1 instances... {{(pid=119659) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:47:43.479082 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-cf83da0d-81f2-4367-a872-7189b2f4e149 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 7a7f3c5c-5f77-4d84-bf07-f73e7929f286] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a726a246-cc7f-46e6-aeff-4d62e03cc091',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119659) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:47:43.494398 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-d1c9b459-a94f-4255-beb9-ca92be30044f tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:43.495146 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-d1c9b459-a94f-4255-beb9-ca92be30044f tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: 6e4576f1-35ce-4081-a2f1-e8e324a1c677] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:43.549858 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-d1c9b459-a94f-4255-beb9-ca92be30044f tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:43.556798 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-d1c9b459-a94f-4255-beb9-ca92be30044f tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/6e4576f1-35ce-4081-a2f1-e8e324a1c677" status: 200 len: 1094 microversion: 2.1 time: 0.066771 Nov 02 14:47:43.557405 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 397/813] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:43 2022] GET /compute/v2.1/servers/6e4576f1-35ce-4081-a2f1-e8e324a1c677 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:47:43.637217 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-cf83da0d-81f2-4367-a872-7189b2f4e149 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.709031 Nov 02 14:47:43.637918 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 417/814] 10.222.0.30 () {60 vars in 1147 bytes} [Wed Nov 2 14:47:42 2022] POST /compute/v2.1/servers => generated 401 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:47:43.649963 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-2311f958-05e3-48f5-a378-62d6981a7611 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:43.650580 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-2311f958-05e3-48f5-a378-62d6981a7611 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 7a7f3c5c-5f77-4d84-bf07-f73e7929f286] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:43.708111 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-2311f958-05e3-48f5-a378-62d6981a7611 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:43.715176 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-2311f958-05e3-48f5-a378-62d6981a7611 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f3c5c-5f77-4d84-bf07-f73e7929f286" status: 200 len: 1241 microversion: 2.1 time: 0.069011 Nov 02 14:47:43.715751 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 398/815] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:43 2022] GET /compute/v2.1/servers/7a7f3c5c-5f77-4d84-bf07-f73e7929f286 => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:44.580691 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-561869ef-db6a-435a-a72c-f31abafa026e tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:44.581346 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-561869ef-db6a-435a-a72c-f31abafa026e tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: 6e4576f1-35ce-4081-a2f1-e8e324a1c677] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:44.637708 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-561869ef-db6a-435a-a72c-f31abafa026e tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:44.645360 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-561869ef-db6a-435a-a72c-f31abafa026e tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/6e4576f1-35ce-4081-a2f1-e8e324a1c677" status: 200 len: 1094 microversion: 2.1 time: 0.069704 Nov 02 14:47:44.645941 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 418/816] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:44 2022] GET /compute/v2.1/servers/6e4576f1-35ce-4081-a2f1-e8e324a1c677 => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:44.740316 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-20759176-932f-4d91-ae2d-9c600fded4f7 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:44.741209 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-20759176-932f-4d91-ae2d-9c600fded4f7 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 7a7f3c5c-5f77-4d84-bf07-f73e7929f286] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:44.748945 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-20759176-932f-4d91-ae2d-9c600fded4f7 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:44.749463 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-20759176-932f-4d91-ae2d-9c600fded4f7 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:44.749898 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-20759176-932f-4d91-ae2d-9c600fded4f7 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:44.751271 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-20759176-932f-4d91-ae2d-9c600fded4f7 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:44.751835 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-20759176-932f-4d91-ae2d-9c600fded4f7 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:44.752372 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-20759176-932f-4d91-ae2d-9c600fded4f7 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:44.816801 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-20759176-932f-4d91-ae2d-9c600fded4f7 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:44.824730 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-20759176-932f-4d91-ae2d-9c600fded4f7 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f3c5c-5f77-4d84-bf07-f73e7929f286" status: 200 len: 1245 microversion: 2.1 time: 0.088477 Nov 02 14:47:44.827850 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 399/817] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:44 2022] GET /compute/v2.1/servers/7a7f3c5c-5f77-4d84-bf07-f73e7929f286 => generated 1245 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:45.667893 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-4f26a29c-968a-48e0-a4ed-0284bdfe2967 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:45.668511 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-4f26a29c-968a-48e0-a4ed-0284bdfe2967 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: 6e4576f1-35ce-4081-a2f1-e8e324a1c677] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:45.724205 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-4f26a29c-968a-48e0-a4ed-0284bdfe2967 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:45.731624 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-4f26a29c-968a-48e0-a4ed-0284bdfe2967 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/6e4576f1-35ce-4081-a2f1-e8e324a1c677" status: 200 len: 1094 microversion: 2.1 time: 0.067648 Nov 02 14:47:45.732212 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 419/818] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:45 2022] GET /compute/v2.1/servers/6e4576f1-35ce-4081-a2f1-e8e324a1c677 => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:45.848847 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-026f1e18-30bf-4fb1-a968-2c4a3138664d tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:45.849837 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-026f1e18-30bf-4fb1-a968-2c4a3138664d tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 7a7f3c5c-5f77-4d84-bf07-f73e7929f286] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:45.856649 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-026f1e18-30bf-4fb1-a968-2c4a3138664d tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:45.857196 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-026f1e18-30bf-4fb1-a968-2c4a3138664d tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:45.857834 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-026f1e18-30bf-4fb1-a968-2c4a3138664d tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:45.864567 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-026f1e18-30bf-4fb1-a968-2c4a3138664d tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:45.864567 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-026f1e18-30bf-4fb1-a968-2c4a3138664d tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:45.864567 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-026f1e18-30bf-4fb1-a968-2c4a3138664d tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:45.933633 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-026f1e18-30bf-4fb1-a968-2c4a3138664d tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:45.937571 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-026f1e18-30bf-4fb1-a968-2c4a3138664d tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f3c5c-5f77-4d84-bf07-f73e7929f286" status: 200 len: 1293 microversion: 2.1 time: 0.093293 Nov 02 14:47:45.938202 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 400/819] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:45 2022] GET /compute/v2.1/servers/7a7f3c5c-5f77-4d84-bf07-f73e7929f286 => generated 1293 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:46.756523 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-f5b3f07a-83eb-4dcf-85d4-a36efaedc11b tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:46.757812 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-f5b3f07a-83eb-4dcf-85d4-a36efaedc11b tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: 6e4576f1-35ce-4081-a2f1-e8e324a1c677] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:46.763894 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f5b3f07a-83eb-4dcf-85d4-a36efaedc11b tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:46.764387 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f5b3f07a-83eb-4dcf-85d4-a36efaedc11b tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:46.764815 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f5b3f07a-83eb-4dcf-85d4-a36efaedc11b tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:46.765542 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f5b3f07a-83eb-4dcf-85d4-a36efaedc11b tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:46.766478 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f5b3f07a-83eb-4dcf-85d4-a36efaedc11b tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:46.766683 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f5b3f07a-83eb-4dcf-85d4-a36efaedc11b tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:46.868818 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-f5b3f07a-83eb-4dcf-85d4-a36efaedc11b tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:46.879415 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-f5b3f07a-83eb-4dcf-85d4-a36efaedc11b tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/6e4576f1-35ce-4081-a2f1-e8e324a1c677" status: 200 len: 1144 microversion: 2.1 time: 0.126453 Nov 02 14:47:46.880495 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 420/820] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:46 2022] GET /compute/v2.1/servers/6e4576f1-35ce-4081-a2f1-e8e324a1c677 => generated 1144 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:46.959897 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-92835f39-e21f-4e50-a892-7c8855f602e6 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:46.960509 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-92835f39-e21f-4e50-a892-7c8855f602e6 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 7a7f3c5c-5f77-4d84-bf07-f73e7929f286] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:46.967302 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-92835f39-e21f-4e50-a892-7c8855f602e6 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:46.967795 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-92835f39-e21f-4e50-a892-7c8855f602e6 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:46.968227 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-92835f39-e21f-4e50-a892-7c8855f602e6 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:46.969519 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-92835f39-e21f-4e50-a892-7c8855f602e6 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:46.970017 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-92835f39-e21f-4e50-a892-7c8855f602e6 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:46.970500 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-92835f39-e21f-4e50-a892-7c8855f602e6 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:47.170775 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-92835f39-e21f-4e50-a892-7c8855f602e6 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:47.181023 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-92835f39-e21f-4e50-a892-7c8855f602e6 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f3c5c-5f77-4d84-bf07-f73e7929f286" status: 200 len: 1366 microversion: 2.1 time: 0.224838 Nov 02 14:47:47.181594 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 401/821] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:46 2022] GET /compute/v2.1/servers/7a7f3c5c-5f77-4d84-bf07-f73e7929f286 => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:47.903270 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-703ac38c-e8f9-4676-8568-650356f1156c tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:47.904940 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-703ac38c-e8f9-4676-8568-650356f1156c tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: 6e4576f1-35ce-4081-a2f1-e8e324a1c677] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:47.912922 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-703ac38c-e8f9-4676-8568-650356f1156c tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:47.913456 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-703ac38c-e8f9-4676-8568-650356f1156c tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:47.913977 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-703ac38c-e8f9-4676-8568-650356f1156c tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:47.915001 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-703ac38c-e8f9-4676-8568-650356f1156c tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:47.915457 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-703ac38c-e8f9-4676-8568-650356f1156c tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:47.915884 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-703ac38c-e8f9-4676-8568-650356f1156c tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:48.139919 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-703ac38c-e8f9-4676-8568-650356f1156c tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:48.148661 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-703ac38c-e8f9-4676-8568-650356f1156c tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/6e4576f1-35ce-4081-a2f1-e8e324a1c677" status: 200 len: 1136 microversion: 2.1 time: 0.249403 Nov 02 14:47:48.149837 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 421/822] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:47 2022] GET /compute/v2.1/servers/6e4576f1-35ce-4081-a2f1-e8e324a1c677 => generated 1136 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:48.206337 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-c51a9763-6f80-42f4-8bfb-45b1cbfaddd4 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:48.206950 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-c51a9763-6f80-42f4-8bfb-45b1cbfaddd4 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 7a7f3c5c-5f77-4d84-bf07-f73e7929f286] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:48.213665 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c51a9763-6f80-42f4-8bfb-45b1cbfaddd4 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:48.214153 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c51a9763-6f80-42f4-8bfb-45b1cbfaddd4 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:48.214588 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c51a9763-6f80-42f4-8bfb-45b1cbfaddd4 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:48.215289 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c51a9763-6f80-42f4-8bfb-45b1cbfaddd4 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:48.215741 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c51a9763-6f80-42f4-8bfb-45b1cbfaddd4 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:48.216163 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c51a9763-6f80-42f4-8bfb-45b1cbfaddd4 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:48.270967 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [req-9fac3572-7cbe-4c2b-b9e0-fa74001e4803 req-6d87bc95-c801-482f-a17c-3d0443b6f4c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a7f3c5c-5f77-4d84-bf07-f73e7929f286", "tag": "b355b9c9-5fd6-4f56-bd5e-6f289f768f89"}]} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:47:48.289937 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-9fac3572-7cbe-4c2b-b9e0-fa74001e4803 req-6d87bc95-c801-482f-a17c-3d0443b6f4c4 service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:48.290311 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-9fac3572-7cbe-4c2b-b9e0-fa74001e4803 req-6d87bc95-c801-482f-a17c-3d0443b6f4c4 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:48.290742 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-9fac3572-7cbe-4c2b-b9e0-fa74001e4803 req-6d87bc95-c801-482f-a17c-3d0443b6f4c4 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:48.305359 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.compute.server_external_events [req-9fac3572-7cbe-4c2b-b9e0-fa74001e4803 req-6d87bc95-c801-482f-a17c-3d0443b6f4c4 service nova] Creating event network-changed:b355b9c9-5fd6-4f56-bd5e-6f289f768f89 for instance 7a7f3c5c-5f77-4d84-bf07-f73e7929f286 on hv-cinder-86236 Nov 02 14:47:48.310308 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [req-9fac3572-7cbe-4c2b-b9e0-fa74001e4803 req-6d87bc95-c801-482f-a17c-3d0443b6f4c4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045390 Nov 02 14:47:48.316228 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 422/823] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:47:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:47:48.459978 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-c51a9763-6f80-42f4-8bfb-45b1cbfaddd4 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:48.464570 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-c51a9763-6f80-42f4-8bfb-45b1cbfaddd4 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f3c5c-5f77-4d84-bf07-f73e7929f286" status: 200 len: 1366 microversion: 2.1 time: 0.262063 Nov 02 14:47:48.467464 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 402/824] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:48 2022] GET /compute/v2.1/servers/7a7f3c5c-5f77-4d84-bf07-f73e7929f286 => generated 1366 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:49.177918 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-2e943de7-e231-4904-891d-cb2be8e6198b tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:49.178829 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-2e943de7-e231-4904-891d-cb2be8e6198b tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: 6e4576f1-35ce-4081-a2f1-e8e324a1c677] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:49.185621 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2e943de7-e231-4904-891d-cb2be8e6198b tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:49.186223 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2e943de7-e231-4904-891d-cb2be8e6198b tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:49.186733 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2e943de7-e231-4904-891d-cb2be8e6198b tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:49.187565 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2e943de7-e231-4904-891d-cb2be8e6198b tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:49.188885 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2e943de7-e231-4904-891d-cb2be8e6198b tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:49.189416 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2e943de7-e231-4904-891d-cb2be8e6198b tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:49.263520 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-2e943de7-e231-4904-891d-cb2be8e6198b tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:49.272371 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-2e943de7-e231-4904-891d-cb2be8e6198b tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/6e4576f1-35ce-4081-a2f1-e8e324a1c677" status: 200 len: 1192 microversion: 2.1 time: 0.101098 Nov 02 14:47:49.272959 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 423/825] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:49 2022] GET /compute/v2.1/servers/6e4576f1-35ce-4081-a2f1-e8e324a1c677 => generated 1192 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:49.492114 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-5c597b23-7de4-4e99-97d4-0b892452868f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:49.492735 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-5c597b23-7de4-4e99-97d4-0b892452868f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 7a7f3c5c-5f77-4d84-bf07-f73e7929f286] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:49.499323 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5c597b23-7de4-4e99-97d4-0b892452868f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:49.499807 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5c597b23-7de4-4e99-97d4-0b892452868f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:49.500280 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5c597b23-7de4-4e99-97d4-0b892452868f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:49.503034 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5c597b23-7de4-4e99-97d4-0b892452868f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:49.503734 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5c597b23-7de4-4e99-97d4-0b892452868f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:49.504366 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5c597b23-7de4-4e99-97d4-0b892452868f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:49.638619 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-5c597b23-7de4-4e99-97d4-0b892452868f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:49.647109 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-5c597b23-7de4-4e99-97d4-0b892452868f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f3c5c-5f77-4d84-bf07-f73e7929f286" status: 200 len: 1366 microversion: 2.1 time: 0.159288 Nov 02 14:47:49.647678 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 403/826] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:49 2022] GET /compute/v2.1/servers/7a7f3c5c-5f77-4d84-bf07-f73e7929f286 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:47:50.296076 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-96b57e02-0017-40f1-8486-042dfde8c892 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:50.296634 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-96b57e02-0017-40f1-8486-042dfde8c892 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: 6e4576f1-35ce-4081-a2f1-e8e324a1c677] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:50.304288 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-96b57e02-0017-40f1-8486-042dfde8c892 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:50.304778 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-96b57e02-0017-40f1-8486-042dfde8c892 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:50.305238 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-96b57e02-0017-40f1-8486-042dfde8c892 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:50.305940 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-96b57e02-0017-40f1-8486-042dfde8c892 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:50.306388 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-96b57e02-0017-40f1-8486-042dfde8c892 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:50.306808 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-96b57e02-0017-40f1-8486-042dfde8c892 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:50.380203 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-96b57e02-0017-40f1-8486-042dfde8c892 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:50.388113 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-96b57e02-0017-40f1-8486-042dfde8c892 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/6e4576f1-35ce-4081-a2f1-e8e324a1c677" status: 200 len: 1210 microversion: 2.1 time: 0.096035 Nov 02 14:47:50.388878 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 424/827] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:50 2022] GET /compute/v2.1/servers/6e4576f1-35ce-4081-a2f1-e8e324a1c677 => generated 1210 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:50.670137 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-f40e8ba1-3680-492b-91c4-ab4304a79803 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:50.670748 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-f40e8ba1-3680-492b-91c4-ab4304a79803 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 7a7f3c5c-5f77-4d84-bf07-f73e7929f286] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:50.678299 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f40e8ba1-3680-492b-91c4-ab4304a79803 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:50.678747 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f40e8ba1-3680-492b-91c4-ab4304a79803 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:50.679911 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f40e8ba1-3680-492b-91c4-ab4304a79803 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:50.679911 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f40e8ba1-3680-492b-91c4-ab4304a79803 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:50.680373 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f40e8ba1-3680-492b-91c4-ab4304a79803 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:50.680908 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f40e8ba1-3680-492b-91c4-ab4304a79803 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:50.826045 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-f40e8ba1-3680-492b-91c4-ab4304a79803 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:50.834515 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-f40e8ba1-3680-492b-91c4-ab4304a79803 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f3c5c-5f77-4d84-bf07-f73e7929f286" status: 200 len: 1366 microversion: 2.1 time: 0.168185 Nov 02 14:47:50.835244 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 404/828] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:50 2022] GET /compute/v2.1/servers/7a7f3c5c-5f77-4d84-bf07-f73e7929f286 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:51.412445 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-e4510a42-40df-4dce-a332-54c2bffdbe3e tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:51.413144 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-e4510a42-40df-4dce-a332-54c2bffdbe3e tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: 6e4576f1-35ce-4081-a2f1-e8e324a1c677] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:51.419850 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e4510a42-40df-4dce-a332-54c2bffdbe3e tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:51.420457 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e4510a42-40df-4dce-a332-54c2bffdbe3e tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:51.421043 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e4510a42-40df-4dce-a332-54c2bffdbe3e tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:51.421774 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e4510a42-40df-4dce-a332-54c2bffdbe3e tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:51.422310 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e4510a42-40df-4dce-a332-54c2bffdbe3e tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:51.422927 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e4510a42-40df-4dce-a332-54c2bffdbe3e tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:51.560067 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-e4510a42-40df-4dce-a332-54c2bffdbe3e tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:51.568383 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-e4510a42-40df-4dce-a332-54c2bffdbe3e tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/6e4576f1-35ce-4081-a2f1-e8e324a1c677" status: 200 len: 1277 microversion: 2.1 time: 0.159947 Nov 02 14:47:51.568947 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 425/829] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:51 2022] GET /compute/v2.1/servers/6e4576f1-35ce-4081-a2f1-e8e324a1c677 => generated 1277 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:47:51.858074 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-ed9437ca-3b1b-4952-95d8-8fce7006f833 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:51.858693 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-ed9437ca-3b1b-4952-95d8-8fce7006f833 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 7a7f3c5c-5f77-4d84-bf07-f73e7929f286] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:51.865796 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ed9437ca-3b1b-4952-95d8-8fce7006f833 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:51.866541 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ed9437ca-3b1b-4952-95d8-8fce7006f833 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:51.867211 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ed9437ca-3b1b-4952-95d8-8fce7006f833 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:51.867673 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ed9437ca-3b1b-4952-95d8-8fce7006f833 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:51.868122 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ed9437ca-3b1b-4952-95d8-8fce7006f833 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:51.868550 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ed9437ca-3b1b-4952-95d8-8fce7006f833 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:51.990722 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [req-13124860-f5ab-4202-aceb-e69e3ce3aff2 req-be38d387-5b83-4fd2-9151-43e60de95c55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e4576f1-35ce-4081-a2f1-e8e324a1c677", "tag": "c8c7d645-c149-4b30-8fb6-474b94827b54"}]} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:47:52.002089 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-13124860-f5ab-4202-aceb-e69e3ce3aff2 req-be38d387-5b83-4fd2-9151-43e60de95c55 service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:52.002579 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-13124860-f5ab-4202-aceb-e69e3ce3aff2 req-be38d387-5b83-4fd2-9151-43e60de95c55 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:52.003017 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-13124860-f5ab-4202-aceb-e69e3ce3aff2 req-be38d387-5b83-4fd2-9151-43e60de95c55 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:52.015308 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-ed9437ca-3b1b-4952-95d8-8fce7006f833 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:52.020352 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.compute.server_external_events [req-13124860-f5ab-4202-aceb-e69e3ce3aff2 req-be38d387-5b83-4fd2-9151-43e60de95c55 service nova] Creating event network-changed:c8c7d645-c149-4b30-8fb6-474b94827b54 for instance 6e4576f1-35ce-4081-a2f1-e8e324a1c677 on hv-cinder-86236 Nov 02 14:47:52.024243 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-ed9437ca-3b1b-4952-95d8-8fce7006f833 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f3c5c-5f77-4d84-bf07-f73e7929f286" status: 200 len: 1366 microversion: 2.1 time: 0.169968 Nov 02 14:47:52.024833 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 405/830] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:51 2022] GET /compute/v2.1/servers/7a7f3c5c-5f77-4d84-bf07-f73e7929f286 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:52.025423 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [req-13124860-f5ab-4202-aceb-e69e3ce3aff2 req-be38d387-5b83-4fd2-9151-43e60de95c55 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040785 Nov 02 14:47:52.026143 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 426/831] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:47:52.592395 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-17644f76-7fb6-435d-aa81-17fcbd2e89d3 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:52.592920 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-17644f76-7fb6-435d-aa81-17fcbd2e89d3 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: 6e4576f1-35ce-4081-a2f1-e8e324a1c677] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:52.599962 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-17644f76-7fb6-435d-aa81-17fcbd2e89d3 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:52.600461 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-17644f76-7fb6-435d-aa81-17fcbd2e89d3 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:52.600906 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-17644f76-7fb6-435d-aa81-17fcbd2e89d3 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:52.601671 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-17644f76-7fb6-435d-aa81-17fcbd2e89d3 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:52.602128 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-17644f76-7fb6-435d-aa81-17fcbd2e89d3 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:52.602587 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-17644f76-7fb6-435d-aa81-17fcbd2e89d3 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:52.737936 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-17644f76-7fb6-435d-aa81-17fcbd2e89d3 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:52.745963 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-17644f76-7fb6-435d-aa81-17fcbd2e89d3 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/6e4576f1-35ce-4081-a2f1-e8e324a1c677" status: 200 len: 1265 microversion: 2.1 time: 0.157774 Nov 02 14:47:52.746528 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 406/832] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:52 2022] GET /compute/v2.1/servers/6e4576f1-35ce-4081-a2f1-e8e324a1c677 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:53.050139 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-ebfb0024-8cb6-4d7b-a86e-dc0d4b2f61f7 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:53.051435 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-ebfb0024-8cb6-4d7b-a86e-dc0d4b2f61f7 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 7a7f3c5c-5f77-4d84-bf07-f73e7929f286] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:53.060465 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ebfb0024-8cb6-4d7b-a86e-dc0d4b2f61f7 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:53.061455 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ebfb0024-8cb6-4d7b-a86e-dc0d4b2f61f7 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:53.062132 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ebfb0024-8cb6-4d7b-a86e-dc0d4b2f61f7 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:53.063655 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ebfb0024-8cb6-4d7b-a86e-dc0d4b2f61f7 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:53.064439 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ebfb0024-8cb6-4d7b-a86e-dc0d4b2f61f7 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:53.064993 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ebfb0024-8cb6-4d7b-a86e-dc0d4b2f61f7 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:53.202582 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-ebfb0024-8cb6-4d7b-a86e-dc0d4b2f61f7 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:53.211514 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-ebfb0024-8cb6-4d7b-a86e-dc0d4b2f61f7 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f3c5c-5f77-4d84-bf07-f73e7929f286" status: 200 len: 1366 microversion: 2.1 time: 0.166600 Nov 02 14:47:53.212101 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 427/833] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:53 2022] GET /compute/v2.1/servers/7a7f3c5c-5f77-4d84-bf07-f73e7929f286 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:53.771220 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-8f639022-4985-461a-bea3-3571574e0d05 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:53.771784 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-8f639022-4985-461a-bea3-3571574e0d05 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: 6e4576f1-35ce-4081-a2f1-e8e324a1c677] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:53.774104 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell0:SELECT=10 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:47:53.778973 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8f639022-4985-461a-bea3-3571574e0d05 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:53.780272 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8f639022-4985-461a-bea3-3571574e0d05 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:53.780272 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8f639022-4985-461a-bea3-3571574e0d05 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:53.780563 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8f639022-4985-461a-bea3-3571574e0d05 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:53.781043 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8f639022-4985-461a-bea3-3571574e0d05 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:53.781985 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8f639022-4985-461a-bea3-3571574e0d05 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:53.917903 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-8f639022-4985-461a-bea3-3571574e0d05 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:53.926362 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-8f639022-4985-461a-bea3-3571574e0d05 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/6e4576f1-35ce-4081-a2f1-e8e324a1c677" status: 200 len: 1265 microversion: 2.1 time: 0.160188 Nov 02 14:47:53.926941 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 407/834] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:53 2022] GET /compute/v2.1/servers/6e4576f1-35ce-4081-a2f1-e8e324a1c677 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:54.236289 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-585058f9-9b3d-4dcd-8482-b9c5733159de tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:54.237096 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-585058f9-9b3d-4dcd-8482-b9c5733159de tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 7a7f3c5c-5f77-4d84-bf07-f73e7929f286] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:54.239313 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell0:SELECT=4 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:47:54.244819 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-585058f9-9b3d-4dcd-8482-b9c5733159de tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:54.245324 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-585058f9-9b3d-4dcd-8482-b9c5733159de tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:54.245756 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-585058f9-9b3d-4dcd-8482-b9c5733159de tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:54.246445 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-585058f9-9b3d-4dcd-8482-b9c5733159de tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:54.260699 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-585058f9-9b3d-4dcd-8482-b9c5733159de tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:54.260699 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-585058f9-9b3d-4dcd-8482-b9c5733159de tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:54.383540 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-585058f9-9b3d-4dcd-8482-b9c5733159de tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:54.392280 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-585058f9-9b3d-4dcd-8482-b9c5733159de tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f3c5c-5f77-4d84-bf07-f73e7929f286" status: 200 len: 1366 microversion: 2.1 time: 0.160310 Nov 02 14:47:54.392865 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 428/835] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:54 2022] GET /compute/v2.1/servers/7a7f3c5c-5f77-4d84-bf07-f73e7929f286 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:54.949164 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-da37cb60-3eda-44f9-8cb5-51f322d44196 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:54.949788 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-da37cb60-3eda-44f9-8cb5-51f322d44196 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: 6e4576f1-35ce-4081-a2f1-e8e324a1c677] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:54.957543 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-da37cb60-3eda-44f9-8cb5-51f322d44196 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:54.958042 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-da37cb60-3eda-44f9-8cb5-51f322d44196 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:54.958489 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-da37cb60-3eda-44f9-8cb5-51f322d44196 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:54.959212 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-da37cb60-3eda-44f9-8cb5-51f322d44196 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:54.959672 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-da37cb60-3eda-44f9-8cb5-51f322d44196 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:54.960106 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-da37cb60-3eda-44f9-8cb5-51f322d44196 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:55.098093 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-da37cb60-3eda-44f9-8cb5-51f322d44196 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:55.107561 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-da37cb60-3eda-44f9-8cb5-51f322d44196 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/6e4576f1-35ce-4081-a2f1-e8e324a1c677" status: 200 len: 1265 microversion: 2.1 time: 0.162245 Nov 02 14:47:55.108572 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 408/836] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:54 2022] GET /compute/v2.1/servers/6e4576f1-35ce-4081-a2f1-e8e324a1c677 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:55.184595 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [req-fda9f01e-2a72-4bef-8ab4-902255f9591b req-1cfe9d26-d471-4d21-a94f-7a340cbeb5d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a7f3c5c-5f77-4d84-bf07-f73e7929f286", "name": "network-vif-plugged", "status": "completed", "tag": "b355b9c9-5fd6-4f56-bd5e-6f289f768f89"}]} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:47:55.195107 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-fda9f01e-2a72-4bef-8ab4-902255f9591b req-1cfe9d26-d471-4d21-a94f-7a340cbeb5d3 service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:55.195591 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-fda9f01e-2a72-4bef-8ab4-902255f9591b req-1cfe9d26-d471-4d21-a94f-7a340cbeb5d3 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:55.196027 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-fda9f01e-2a72-4bef-8ab4-902255f9591b req-1cfe9d26-d471-4d21-a94f-7a340cbeb5d3 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:55.208186 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.compute.server_external_events [req-fda9f01e-2a72-4bef-8ab4-902255f9591b req-1cfe9d26-d471-4d21-a94f-7a340cbeb5d3 service nova] Creating event network-vif-plugged:b355b9c9-5fd6-4f56-bd5e-6f289f768f89 for instance 7a7f3c5c-5f77-4d84-bf07-f73e7929f286 on hv-cinder-86236 Nov 02 14:47:55.213065 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [req-fda9f01e-2a72-4bef-8ab4-902255f9591b req-1cfe9d26-d471-4d21-a94f-7a340cbeb5d3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032184 Nov 02 14:47:55.217668 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 429/837] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:47:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:47:55.415123 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-9605b820-418a-4c07-8660-8111988a841b tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:55.415746 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-9605b820-418a-4c07-8660-8111988a841b tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 7a7f3c5c-5f77-4d84-bf07-f73e7929f286] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:55.421756 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9605b820-418a-4c07-8660-8111988a841b tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:55.422910 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9605b820-418a-4c07-8660-8111988a841b tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:55.423341 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9605b820-418a-4c07-8660-8111988a841b tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:55.424112 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9605b820-418a-4c07-8660-8111988a841b tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:55.424510 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9605b820-418a-4c07-8660-8111988a841b tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:55.424928 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9605b820-418a-4c07-8660-8111988a841b tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:55.557048 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-9605b820-418a-4c07-8660-8111988a841b tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:55.564908 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-9605b820-418a-4c07-8660-8111988a841b tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f3c5c-5f77-4d84-bf07-f73e7929f286" status: 200 len: 1366 microversion: 2.1 time: 0.153553 Nov 02 14:47:55.565516 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 409/838] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:55 2022] GET /compute/v2.1/servers/7a7f3c5c-5f77-4d84-bf07-f73e7929f286 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:47:56.001627 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell0:SELECT=16 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:47:56.005834 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-316f33ad-943c-4652-8009-4caa1ca52a64 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:56.008149 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-316f33ad-943c-4652-8009-4caa1ca52a64 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:56.014281 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-316f33ad-943c-4652-8009-4caa1ca52a64 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:56.014757 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-316f33ad-943c-4652-8009-4caa1ca52a64 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:56.015188 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-316f33ad-943c-4652-8009-4caa1ca52a64 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:56.016490 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-316f33ad-943c-4652-8009-4caa1ca52a64 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:56.016941 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-316f33ad-943c-4652-8009-4caa1ca52a64 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:56.017396 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-316f33ad-943c-4652-8009-4caa1ca52a64 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:56.049303 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-316f33ad-943c-4652-8009-4caa1ca52a64 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049634 Nov 02 14:47:56.049886 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 430/839] 10.222.0.30 () {58 vars in 1302 bytes} [Wed Nov 2 14:47:55 2022] GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 14:47:56.130553 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-97eb85c8-e535-42d4-b829-fa53c72ec03c tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:56.131116 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-97eb85c8-e535-42d4-b829-fa53c72ec03c tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:56.131988 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-fe08711e-76c8-465d-bb77-89ec71235034 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:56.132690 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-fe08711e-76c8-465d-bb77-89ec71235034 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: 6e4576f1-35ce-4081-a2f1-e8e324a1c677] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:56.137672 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-97eb85c8-e535-42d4-b829-fa53c72ec03c tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:56.138191 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-97eb85c8-e535-42d4-b829-fa53c72ec03c tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:56.138644 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-97eb85c8-e535-42d4-b829-fa53c72ec03c tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:56.138775 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fe08711e-76c8-465d-bb77-89ec71235034 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:56.139202 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fe08711e-76c8-465d-bb77-89ec71235034 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:56.139353 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-97eb85c8-e535-42d4-b829-fa53c72ec03c tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:56.139639 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fe08711e-76c8-465d-bb77-89ec71235034 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:56.139883 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-97eb85c8-e535-42d4-b829-fa53c72ec03c tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:56.140321 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-97eb85c8-e535-42d4-b829-fa53c72ec03c tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:56.140430 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fe08711e-76c8-465d-bb77-89ec71235034 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:56.141548 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fe08711e-76c8-465d-bb77-89ec71235034 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:56.141987 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fe08711e-76c8-465d-bb77-89ec71235034 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:56.169162 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-97eb85c8-e535-42d4-b829-fa53c72ec03c tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Going to try to terminate instance {{(pid=119658) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:47:56.433414 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-fe08711e-76c8-465d-bb77-89ec71235034 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:56.442304 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-fe08711e-76c8-465d-bb77-89ec71235034 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/6e4576f1-35ce-4081-a2f1-e8e324a1c677" status: 200 len: 1265 microversion: 2.1 time: 0.314321 Nov 02 14:47:56.442859 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 431/840] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:56 2022] GET /compute/v2.1/servers/6e4576f1-35ce-4081-a2f1-e8e324a1c677 => generated 1265 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:47:56.443609 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-97eb85c8-e535-42d4-b829-fa53c72ec03c tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290" status: 204 len: 0 microversion: 2.1 time: 0.317077 Nov 02 14:47:56.444199 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 410/841] 10.222.0.30 () {58 vars in 1239 bytes} [Wed Nov 2 14:47:56 2022] DELETE /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:47:56.452284 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-73b78108-c4c9-44fb-86ea-88b4359e9f9a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:56.452898 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-73b78108-c4c9-44fb-86ea-88b4359e9f9a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:56.458873 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-73b78108-c4c9-44fb-86ea-88b4359e9f9a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:56.459359 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-73b78108-c4c9-44fb-86ea-88b4359e9f9a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:56.459798 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-73b78108-c4c9-44fb-86ea-88b4359e9f9a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:56.460490 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-73b78108-c4c9-44fb-86ea-88b4359e9f9a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:56.460942 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-73b78108-c4c9-44fb-86ea-88b4359e9f9a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:56.461423 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-73b78108-c4c9-44fb-86ea-88b4359e9f9a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:56.588612 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-8f87f5d3-68b0-47b5-afe1-98df55b71d45 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:56.589260 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-8f87f5d3-68b0-47b5-afe1-98df55b71d45 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 7a7f3c5c-5f77-4d84-bf07-f73e7929f286] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:56.594193 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-73b78108-c4c9-44fb-86ea-88b4359e9f9a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:56.595343 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8f87f5d3-68b0-47b5-afe1-98df55b71d45 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:56.595824 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8f87f5d3-68b0-47b5-afe1-98df55b71d45 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:56.596444 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8f87f5d3-68b0-47b5-afe1-98df55b71d45 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:56.597177 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8f87f5d3-68b0-47b5-afe1-98df55b71d45 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:56.597624 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8f87f5d3-68b0-47b5-afe1-98df55b71d45 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:56.598054 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8f87f5d3-68b0-47b5-afe1-98df55b71d45 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:56.602065 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-73b78108-c4c9-44fb-86ea-88b4359e9f9a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290" status: 200 len: 1673 microversion: 2.1 time: 0.153672 Nov 02 14:47:56.602629 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 432/842] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:56 2022] GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290 => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:56.729590 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-8f87f5d3-68b0-47b5-afe1-98df55b71d45 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:56.738147 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-8f87f5d3-68b0-47b5-afe1-98df55b71d45 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f3c5c-5f77-4d84-bf07-f73e7929f286" status: 200 len: 1366 microversion: 2.1 time: 0.153793 Nov 02 14:47:56.738713 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 411/843] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:56 2022] GET /compute/v2.1/servers/7a7f3c5c-5f77-4d84-bf07-f73e7929f286 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:47:57.465270 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-8f1934c9-7fe7-4c27-8cae-8254f81add2d tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:57.465876 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-8f1934c9-7fe7-4c27-8cae-8254f81add2d tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: 6e4576f1-35ce-4081-a2f1-e8e324a1c677] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:57.473577 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8f1934c9-7fe7-4c27-8cae-8254f81add2d tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:57.474069 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8f1934c9-7fe7-4c27-8cae-8254f81add2d tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:57.474506 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8f1934c9-7fe7-4c27-8cae-8254f81add2d tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:57.475321 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8f1934c9-7fe7-4c27-8cae-8254f81add2d tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:57.475773 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8f1934c9-7fe7-4c27-8cae-8254f81add2d tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:57.476201 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8f1934c9-7fe7-4c27-8cae-8254f81add2d tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:57.615981 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-8f1934c9-7fe7-4c27-8cae-8254f81add2d tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:57.624375 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-8f1934c9-7fe7-4c27-8cae-8254f81add2d tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/6e4576f1-35ce-4081-a2f1-e8e324a1c677" status: 200 len: 1265 microversion: 2.1 time: 0.163029 Nov 02 14:47:57.625569 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 433/844] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:57 2022] GET /compute/v2.1/servers/6e4576f1-35ce-4081-a2f1-e8e324a1c677 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:57.626170 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-8c74ebb3-bbf4-4c24-a5e4-7f4bb3bb23cd tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:57.626799 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-8c74ebb3-bbf4-4c24-a5e4-7f4bb3bb23cd tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:57.633553 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8c74ebb3-bbf4-4c24-a5e4-7f4bb3bb23cd tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:57.634071 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8c74ebb3-bbf4-4c24-a5e4-7f4bb3bb23cd tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:57.634488 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8c74ebb3-bbf4-4c24-a5e4-7f4bb3bb23cd tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:57.635188 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8c74ebb3-bbf4-4c24-a5e4-7f4bb3bb23cd tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:57.635645 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8c74ebb3-bbf4-4c24-a5e4-7f4bb3bb23cd tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:57.636077 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8c74ebb3-bbf4-4c24-a5e4-7f4bb3bb23cd tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:57.638823 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:47:57.761428 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-f521d252-23bf-4214-822e-a370238cf30f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:57.762041 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-f521d252-23bf-4214-822e-a370238cf30f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 7a7f3c5c-5f77-4d84-bf07-f73e7929f286] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:57.768685 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f521d252-23bf-4214-822e-a370238cf30f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:57.769198 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f521d252-23bf-4214-822e-a370238cf30f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:57.769361 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-8c74ebb3-bbf4-4c24-a5e4-7f4bb3bb23cd tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:57.769635 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f521d252-23bf-4214-822e-a370238cf30f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:57.770334 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f521d252-23bf-4214-822e-a370238cf30f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:57.770778 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f521d252-23bf-4214-822e-a370238cf30f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:57.771194 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f521d252-23bf-4214-822e-a370238cf30f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:57.777280 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-8c74ebb3-bbf4-4c24-a5e4-7f4bb3bb23cd tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290" status: 200 len: 1673 microversion: 2.1 time: 0.155450 Nov 02 14:47:57.777860 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 412/845] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:57 2022] GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290 => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:47:57.902593 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-f521d252-23bf-4214-822e-a370238cf30f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:57.910497 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-f521d252-23bf-4214-822e-a370238cf30f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f3c5c-5f77-4d84-bf07-f73e7929f286" status: 200 len: 1366 microversion: 2.1 time: 0.152962 Nov 02 14:47:57.911061 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 434/846] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:57 2022] GET /compute/v2.1/servers/7a7f3c5c-5f77-4d84-bf07-f73e7929f286 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:47:58.648049 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-8e26cfb2-5892-4d64-8b78-ce3ff148b0d9 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:58.648666 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-8e26cfb2-5892-4d64-8b78-ce3ff148b0d9 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: 6e4576f1-35ce-4081-a2f1-e8e324a1c677] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:58.655018 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8e26cfb2-5892-4d64-8b78-ce3ff148b0d9 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:58.655499 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8e26cfb2-5892-4d64-8b78-ce3ff148b0d9 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:58.655936 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8e26cfb2-5892-4d64-8b78-ce3ff148b0d9 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:58.656681 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8e26cfb2-5892-4d64-8b78-ce3ff148b0d9 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:58.657213 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8e26cfb2-5892-4d64-8b78-ce3ff148b0d9 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:58.657645 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8e26cfb2-5892-4d64-8b78-ce3ff148b0d9 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:58.789819 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-8e26cfb2-5892-4d64-8b78-ce3ff148b0d9 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:58.799024 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-8e26cfb2-5892-4d64-8b78-ce3ff148b0d9 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/6e4576f1-35ce-4081-a2f1-e8e324a1c677" status: 200 len: 1265 microversion: 2.1 time: 0.154823 Nov 02 14:47:58.804878 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 413/847] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:58 2022] GET /compute/v2.1/servers/6e4576f1-35ce-4081-a2f1-e8e324a1c677 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:58.807531 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-a03a9f04-6588-47e5-b1c7-8db075a1f1f5 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:58.807531 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-a03a9f04-6588-47e5-b1c7-8db075a1f1f5 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:58.807994 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a03a9f04-6588-47e5-b1c7-8db075a1f1f5 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:58.808253 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a03a9f04-6588-47e5-b1c7-8db075a1f1f5 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:58.808690 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a03a9f04-6588-47e5-b1c7-8db075a1f1f5 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:58.809435 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a03a9f04-6588-47e5-b1c7-8db075a1f1f5 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:58.809896 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a03a9f04-6588-47e5-b1c7-8db075a1f1f5 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:58.810542 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a03a9f04-6588-47e5-b1c7-8db075a1f1f5 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:58.934447 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-097d883d-1b57-4921-9e9a-66d7b26eeffb tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:58.935059 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-097d883d-1b57-4921-9e9a-66d7b26eeffb tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 7a7f3c5c-5f77-4d84-bf07-f73e7929f286] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:58.941858 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-097d883d-1b57-4921-9e9a-66d7b26eeffb tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:58.942229 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-097d883d-1b57-4921-9e9a-66d7b26eeffb tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:58.942663 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-097d883d-1b57-4921-9e9a-66d7b26eeffb tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:58.943357 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-097d883d-1b57-4921-9e9a-66d7b26eeffb tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:58.943811 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-097d883d-1b57-4921-9e9a-66d7b26eeffb tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:58.944236 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-097d883d-1b57-4921-9e9a-66d7b26eeffb tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:58.944362 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-a03a9f04-6588-47e5-b1c7-8db075a1f1f5 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:58.951895 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-a03a9f04-6588-47e5-b1c7-8db075a1f1f5 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290" status: 200 len: 1673 microversion: 2.1 time: 0.156045 Nov 02 14:47:58.952741 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 435/848] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:58 2022] GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290 => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:47:59.079262 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-097d883d-1b57-4921-9e9a-66d7b26eeffb tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:59.087088 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-097d883d-1b57-4921-9e9a-66d7b26eeffb tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f3c5c-5f77-4d84-bf07-f73e7929f286" status: 200 len: 1556 microversion: 2.1 time: 0.156529 Nov 02 14:47:59.087875 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 414/849] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:58 2022] GET /compute/v2.1/servers/7a7f3c5c-5f77-4d84-bf07-f73e7929f286 => generated 1556 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:47:59.109914 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-27bd9880-dc35-496a-b11f-31b69c1cabae tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:59.110402 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-27bd9880-dc35-496a-b11f-31b69c1cabae tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 7a7f3c5c-5f77-4d84-bf07-f73e7929f286] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:59.116759 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-27bd9880-dc35-496a-b11f-31b69c1cabae tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:59.117270 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-27bd9880-dc35-496a-b11f-31b69c1cabae tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:59.117703 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-27bd9880-dc35-496a-b11f-31b69c1cabae tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:59.118383 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-27bd9880-dc35-496a-b11f-31b69c1cabae tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:59.118830 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-27bd9880-dc35-496a-b11f-31b69c1cabae tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:59.119274 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-27bd9880-dc35-496a-b11f-31b69c1cabae tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:59.195522 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-27bd9880-dc35-496a-b11f-31b69c1cabae tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f3c5c-5f77-4d84-bf07-f73e7929f286/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089581 Nov 02 14:47:59.196148 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 436/850] 10.222.0.30 () {58 vars in 1275 bytes} [Wed Nov 2 14:47:59 2022] GET /compute/v2.1/servers/7a7f3c5c-5f77-4d84-bf07-f73e7929f286/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:47:59.823723 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-c62a57a5-962d-4bc3-994a-9b88f2d83357 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:59.824287 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-c62a57a5-962d-4bc3-994a-9b88f2d83357 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: 6e4576f1-35ce-4081-a2f1-e8e324a1c677] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:59.831082 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c62a57a5-962d-4bc3-994a-9b88f2d83357 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:59.831706 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c62a57a5-962d-4bc3-994a-9b88f2d83357 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:59.832217 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c62a57a5-962d-4bc3-994a-9b88f2d83357 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:59.832996 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c62a57a5-962d-4bc3-994a-9b88f2d83357 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:59.833545 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c62a57a5-962d-4bc3-994a-9b88f2d83357 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:59.834044 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c62a57a5-962d-4bc3-994a-9b88f2d83357 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:59.975906 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-9dee1a6d-1608-43ae-a561-9d3665a476d9 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:59.976588 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-9dee1a6d-1608-43ae-a561-9d3665a476d9 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:59.985657 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9dee1a6d-1608-43ae-a561-9d3665a476d9 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:59.986297 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9dee1a6d-1608-43ae-a561-9d3665a476d9 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:59.987089 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9dee1a6d-1608-43ae-a561-9d3665a476d9 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:59.988329 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9dee1a6d-1608-43ae-a561-9d3665a476d9 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:59.988867 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9dee1a6d-1608-43ae-a561-9d3665a476d9 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:59.989436 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9dee1a6d-1608-43ae-a561-9d3665a476d9 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:00.080622 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-c62a57a5-962d-4bc3-994a-9b88f2d83357 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:48:00.088649 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-c62a57a5-962d-4bc3-994a-9b88f2d83357 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/6e4576f1-35ce-4081-a2f1-e8e324a1c677" status: 200 len: 1265 microversion: 2.1 time: 0.268791 Nov 02 14:48:00.089258 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 415/851] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:59 2022] GET /compute/v2.1/servers/6e4576f1-35ce-4081-a2f1-e8e324a1c677 => generated 1265 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:48:00.229579 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-9dee1a6d-1608-43ae-a561-9d3665a476d9 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:48:00.239082 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-9dee1a6d-1608-43ae-a561-9d3665a476d9 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290" status: 200 len: 1673 microversion: 2.1 time: 0.266913 Nov 02 14:48:00.239676 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 437/852] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:59 2022] GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290 => generated 1673 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:48:00.405517 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [req-2096eb8a-f162-4a44-a4dd-4a39b917ba37 req-d24dcee8-0a0b-4193-a228-1e204153f7ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a7f3c5c-5f77-4d84-bf07-f73e7929f286", "tag": "b355b9c9-5fd6-4f56-bd5e-6f289f768f89"}]} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:48:00.420197 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-2096eb8a-f162-4a44-a4dd-4a39b917ba37 req-d24dcee8-0a0b-4193-a228-1e204153f7ef service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:00.420972 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-2096eb8a-f162-4a44-a4dd-4a39b917ba37 req-d24dcee8-0a0b-4193-a228-1e204153f7ef service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:00.422488 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-2096eb8a-f162-4a44-a4dd-4a39b917ba37 req-d24dcee8-0a0b-4193-a228-1e204153f7ef service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:00.438455 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.compute.server_external_events [req-2096eb8a-f162-4a44-a4dd-4a39b917ba37 req-d24dcee8-0a0b-4193-a228-1e204153f7ef service nova] Creating event network-changed:b355b9c9-5fd6-4f56-bd5e-6f289f768f89 for instance 7a7f3c5c-5f77-4d84-bf07-f73e7929f286 on hv-cinder-86236 Nov 02 14:48:00.444323 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [req-2096eb8a-f162-4a44-a4dd-4a39b917ba37 req-d24dcee8-0a0b-4193-a228-1e204153f7ef service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046557 Nov 02 14:48:00.449271 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 416/853] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:48:00.451925 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [req-b2d38af2-b67b-4bc3-9b48-dd6a65a1cfa2 req-2e70234f-e864-47ad-98e2-bc12f29dc19b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dff2e06-ddf6-4c7a-8887-40092f0f9290", "name": "network-vif-deleted", "tag": "dbd39cbf-326e-49d0-90e6-27faedce220f"}]} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:48:00.461630 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-b2d38af2-b67b-4bc3-9b48-dd6a65a1cfa2 req-2e70234f-e864-47ad-98e2-bc12f29dc19b service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:00.462210 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-b2d38af2-b67b-4bc3-9b48-dd6a65a1cfa2 req-2e70234f-e864-47ad-98e2-bc12f29dc19b service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:00.462645 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-b2d38af2-b67b-4bc3-9b48-dd6a65a1cfa2 req-2e70234f-e864-47ad-98e2-bc12f29dc19b service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:00.474566 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.compute.server_external_events [req-b2d38af2-b67b-4bc3-9b48-dd6a65a1cfa2 req-2e70234f-e864-47ad-98e2-bc12f29dc19b service nova] Creating event network-vif-deleted:dbd39cbf-326e-49d0-90e6-27faedce220f for instance 9dff2e06-ddf6-4c7a-8887-40092f0f9290 on hv-cinder-86236 Nov 02 14:48:00.480080 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [req-b2d38af2-b67b-4bc3-9b48-dd6a65a1cfa2 req-2e70234f-e864-47ad-98e2-bc12f29dc19b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031660 Nov 02 14:48:00.483968 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 438/854] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:48:01.114165 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-ff683f71-7396-459f-b5b1-62a176f5fcb3 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:01.115491 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-ff683f71-7396-459f-b5b1-62a176f5fcb3 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: 6e4576f1-35ce-4081-a2f1-e8e324a1c677] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:01.123327 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ff683f71-7396-459f-b5b1-62a176f5fcb3 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:01.124056 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ff683f71-7396-459f-b5b1-62a176f5fcb3 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:01.126111 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ff683f71-7396-459f-b5b1-62a176f5fcb3 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:01.127095 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ff683f71-7396-459f-b5b1-62a176f5fcb3 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:01.127726 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ff683f71-7396-459f-b5b1-62a176f5fcb3 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:01.128326 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ff683f71-7396-459f-b5b1-62a176f5fcb3 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:01.265378 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-ff64ff8a-ef8e-4763-8c19-cc7661ed6d92 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:01.266625 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-ff64ff8a-ef8e-4763-8c19-cc7661ed6d92 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:01.273870 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ff64ff8a-ef8e-4763-8c19-cc7661ed6d92 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:01.274741 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ff64ff8a-ef8e-4763-8c19-cc7661ed6d92 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:01.275362 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ff64ff8a-ef8e-4763-8c19-cc7661ed6d92 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:01.276219 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ff64ff8a-ef8e-4763-8c19-cc7661ed6d92 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:01.277046 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ff64ff8a-ef8e-4763-8c19-cc7661ed6d92 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:01.277625 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ff64ff8a-ef8e-4763-8c19-cc7661ed6d92 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:01.279492 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-ff683f71-7396-459f-b5b1-62a176f5fcb3 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:48:01.283414 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell1:SELECT=100 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:48:01.294518 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-ff683f71-7396-459f-b5b1-62a176f5fcb3 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/6e4576f1-35ce-4081-a2f1-e8e324a1c677" status: 200 len: 1265 microversion: 2.1 time: 0.185498 Nov 02 14:48:01.295404 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 417/855] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:48:01 2022] GET /compute/v2.1/servers/6e4576f1-35ce-4081-a2f1-e8e324a1c677 => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:48:01.315914 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ff64ff8a-ef8e-4763-8c19-cc7661ed6d92 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:01.316533 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ff64ff8a-ef8e-4763-8c19-cc7661ed6d92 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:01.317063 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ff64ff8a-ef8e-4763-8c19-cc7661ed6d92 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:01.317604 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.objects.instance [None req-ff64ff8a-ef8e-4763-8c19-cc7661ed6d92 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lazy-loading 'fault' on Instance uuid 9dff2e06-ddf6-4c7a-8887-40092f0f9290 {{(pid=119659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:48:01.368011 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-ff64ff8a-ef8e-4763-8c19-cc7661ed6d92 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:48:01.378013 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-ff64ff8a-ef8e-4763-8c19-cc7661ed6d92 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290" status: 200 len: 1326 microversion: 2.1 time: 0.117449 Nov 02 14:48:01.378671 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 439/856] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:48:01 2022] GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290 => generated 1326 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:48:02.319595 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-3de31e33-4578-42f5-a0fe-4b64c4e7a95d tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:02.320212 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-3de31e33-4578-42f5-a0fe-4b64c4e7a95d tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: 6e4576f1-35ce-4081-a2f1-e8e324a1c677] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:02.327166 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3de31e33-4578-42f5-a0fe-4b64c4e7a95d tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:02.327667 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3de31e33-4578-42f5-a0fe-4b64c4e7a95d tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:02.328699 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3de31e33-4578-42f5-a0fe-4b64c4e7a95d tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:02.329478 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3de31e33-4578-42f5-a0fe-4b64c4e7a95d tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:02.329935 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3de31e33-4578-42f5-a0fe-4b64c4e7a95d tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:02.330363 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3de31e33-4578-42f5-a0fe-4b64c4e7a95d tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:02.402774 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-0c1900de-b91b-4ea3-aab4-be41896437d8 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:02.403468 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-0c1900de-b91b-4ea3-aab4-be41896437d8 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:02.411172 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0c1900de-b91b-4ea3-aab4-be41896437d8 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:02.411666 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0c1900de-b91b-4ea3-aab4-be41896437d8 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:02.412211 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0c1900de-b91b-4ea3-aab4-be41896437d8 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:02.412933 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0c1900de-b91b-4ea3-aab4-be41896437d8 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:02.413428 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0c1900de-b91b-4ea3-aab4-be41896437d8 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:02.413859 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0c1900de-b91b-4ea3-aab4-be41896437d8 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:02.434081 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.wsgi [None req-0c1900de-b91b-4ea3-aab4-be41896437d8 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] HTTP exception thrown: Instance 9dff2e06-ddf6-4c7a-8887-40092f0f9290 could not be found. Nov 02 14:48:02.435784 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-0c1900de-b91b-4ea3-aab4-be41896437d8 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Request method failure captured: Nov 02 14:48:02.435784 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: request: GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290 HTTP/1.1 Nov 02 14:48:02.435784 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Accept: application/json Nov 02 14:48:02.435784 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Accept-Encoding: identity Nov 02 14:48:02.435784 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Connection: close Nov 02 14:48:02.435784 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Content-Length: 0 Nov 02 14:48:02.435784 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Content-Type: application/json Nov 02 14:48:02.435784 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Host: 10.222.0.30 Nov 02 14:48:02.435784 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Openstack-System-Scope: None Nov 02 14:48:02.435784 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: User-Agent: python-urllib3/1.26.12 Nov 02 14:48:02.435784 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Auth-Token: gAAAAABjYoJpouzTtMAiiS2m-qbZYsM19K1NYzXoh_Ug2s1Oyy1UWotkESdRxWL31k2eSzlbFi0CSuxtkkgrcjIxQAj2oKg5rSgNfrDQCBT6qSsuHlNry_j922Z87azrIo4qbg3XvOK8bRdYI4jTLV9QyDJKXYEKvzAifuFkgpEaqo4RVpKRhaM Nov 02 14:48:02.435784 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Domain-Id: None Nov 02 14:48:02.435784 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Domain-Name: None Nov 02 14:48:02.435784 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Identity-Status: Confirmed Nov 02 14:48:02.435784 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Is-Admin-Project: True Nov 02 14:48:02.435784 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Domain-Id: default Nov 02 14:48:02.435784 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Domain-Name: Default Nov 02 14:48:02.435784 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Id: 2bf7381b1bf545c39936c96595aa36f4 Nov 02 14:48:02.435784 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Name: tempest-AttachVolumeTestJSON-833749050 Nov 02 14:48:02.435784 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Role: reader,member Nov 02 14:48:02.435784 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Roles: reader,member Nov 02 14:48:02.438078 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2bf7381b1bf545c39936c96595aa36f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2bf7381b1bf545c39936c96595aa36f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2bf7381b1bf545c39936c96595aa36f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2bf7381b1bf545c39936c96595aa36f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:48:02.438078 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant: tempest-AttachVolumeTestJSON-833749050 Nov 02 14:48:02.438078 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant-Id: 2bf7381b1bf545c39936c96595aa36f4 Nov 02 14:48:02.438078 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant-Name: tempest-AttachVolumeTestJSON-833749050 Nov 02 14:48:02.438078 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User: tempest-AttachVolumeTestJSON-833749050-project Nov 02 14:48:02.438078 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Domain-Id: default Nov 02 14:48:02.438078 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Domain-Name: Default Nov 02 14:48:02.438078 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Id: 6069bdb19c5c42ff8546aef3197a6a2b Nov 02 14:48:02.438078 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Name: tempest-AttachVolumeTestJSON-833749050-project Nov 02 14:48:02.438078 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: method: > Nov 02 14:48:02.438078 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: exception: Instance 9dff2e06-ddf6-4c7a-8887-40092f0f9290 could not be found. Nov 02 14:48:02.438078 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: action_args: {'id': '9dff2e06-ddf6-4c7a-8887-40092f0f9290'} Nov 02 14:48:02.442637 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:48:02.442637 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:48:02.442637 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:48:02.442637 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:48:02.442637 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:48:02.442637 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:48:02.442637 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:48:02.442637 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:48:02.442637 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:48:02.442637 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:48:02.442637 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dff2e06-ddf6-4c7a-8887-40092f0f9290 could not be found. Nov 02 14:48:02.442637 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:48:02.442637 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:48:02.442637 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:48:02.442637 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:48:02.442637 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:48:02.442637 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:48:02.442637 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:48:02.442637 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:48:02.442637 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:48:02.444239 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:48:02.444239 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:48:02.444239 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:48:02.444239 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:48:02.444239 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:48:02.444239 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:48:02.444239 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:48:02.444239 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dff2e06-ddf6-4c7a-8887-40092f0f9290 could not be found. Nov 02 14:48:02.444239 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:48:02.444239 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:48:02.444239 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:48:02.444239 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:48:02.444239 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:48:02.444239 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:48:02.444239 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:48:02.444239 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:48:02.444239 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dff2e06-ddf6-4c7a-8887-40092f0f9290 could not be found. Nov 02 14:48:02.444239 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:48:02.445641 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-0c1900de-b91b-4ea3-aab4-be41896437d8 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Returning 404 to user: Instance 9dff2e06-ddf6-4c7a-8887-40092f0f9290 could not be found. {{(pid=119659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:48:02.445641 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-0c1900de-b91b-4ea3-aab4-be41896437d8 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290" status: 404 len: 111 microversion: 2.1 time: 0.038376 Nov 02 14:48:02.445641 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 440/857] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:48:02 2022] GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 14:48:02.446973 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-0ee1b7f4-59f4-4974-a33a-becd8fa32302 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '.version_select at 0x7fb24ec4f670>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:02.474632 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-3de31e33-4578-42f5-a0fe-4b64c4e7a95d tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:48:02.482438 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-3de31e33-4578-42f5-a0fe-4b64c4e7a95d tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/6e4576f1-35ce-4081-a2f1-e8e324a1c677" status: 200 len: 1265 microversion: 2.1 time: 0.166719 Nov 02 14:48:02.483004 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 418/858] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:48:02 2022] GET /compute/v2.1/servers/6e4576f1-35ce-4081-a2f1-e8e324a1c677 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:48:02.518535 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-0ee1b7f4-59f4-4974-a33a-becd8fa32302 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-551645791" status: 202 len: 0 microversion: 2.1 time: 0.075404 Nov 02 14:48:02.519102 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 441/859] 10.222.0.30 () {58 vars in 1218 bytes} [Wed Nov 2 14:48:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-551645791 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 14:48:03.228055 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [req-e5bdadb1-fb59-427c-b8a5-31e9bc99ea09 req-8f3e8663-835d-43f0-9375-582e49ac7cf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e4576f1-35ce-4081-a2f1-e8e324a1c677", "name": "network-vif-plugged", "status": "completed", "tag": "c8c7d645-c149-4b30-8fb6-474b94827b54"}]} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:48:03.244576 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-e5bdadb1-fb59-427c-b8a5-31e9bc99ea09 req-8f3e8663-835d-43f0-9375-582e49ac7cf3 service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:03.244576 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-e5bdadb1-fb59-427c-b8a5-31e9bc99ea09 req-8f3e8663-835d-43f0-9375-582e49ac7cf3 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:03.244576 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-e5bdadb1-fb59-427c-b8a5-31e9bc99ea09 req-8f3e8663-835d-43f0-9375-582e49ac7cf3 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:03.251208 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.compute.server_external_events [req-e5bdadb1-fb59-427c-b8a5-31e9bc99ea09 req-8f3e8663-835d-43f0-9375-582e49ac7cf3 service nova] Creating event network-vif-plugged:c8c7d645-c149-4b30-8fb6-474b94827b54 for instance 6e4576f1-35ce-4081-a2f1-e8e324a1c677 on hv-cinder-86236 Nov 02 14:48:03.256238 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [req-e5bdadb1-fb59-427c-b8a5-31e9bc99ea09 req-8f3e8663-835d-43f0-9375-582e49ac7cf3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032341 Nov 02 14:48:03.256959 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 419/860] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:48:03.309940 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-bfd2695f-f138-4199-b1ab-86ec5c6a7428 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Action: 'create', calling method: .version_select at 0x7fb24ed61790>, body: {"keypair": {"name": "tempest-keypair-195435391", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNgE4z39sdqsHG2P3CootZEdIGclQKK+EnlBJv5/QBt/FUlb8PdR8jyg95o0CaJlZlV4fv50zl/wOkL7tvTwxal4Y4CeE2GUosN81dgptE/sKuc+0h2Ms7osCK3sKzpmNw=="}} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:48:03.326850 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.quota [None req-bfd2695f-f138-4199-b1ab-86ec5c6a7428 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Getting quotas for project 2bf7381b1bf545c39936c96595aa36f4. Resources: {'key_pairs'} {{(pid=119659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:48:03.331767 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.quota [None req-bfd2695f-f138-4199-b1ab-86ec5c6a7428 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Getting quotas for user 6069bdb19c5c42ff8546aef3197a6a2b and project 2bf7381b1bf545c39936c96595aa36f4. Resources: {'key_pairs'} {{(pid=119659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:48:03.333284 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:48:03.396646 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-bfd2695f-f138-4199-b1ab-86ec5c6a7428 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.094484 Nov 02 14:48:03.397288 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 442/861] 10.222.0.30 () {60 vars in 1159 bytes} [Wed Nov 2 14:48:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:48:03.506876 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-0d2b19a1-39d5-43df-959c-3f8b9457e575 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:03.508164 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-0d2b19a1-39d5-43df-959c-3f8b9457e575 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: 6e4576f1-35ce-4081-a2f1-e8e324a1c677] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:03.514256 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0d2b19a1-39d5-43df-959c-3f8b9457e575 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:03.514749 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0d2b19a1-39d5-43df-959c-3f8b9457e575 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:03.515233 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0d2b19a1-39d5-43df-959c-3f8b9457e575 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:03.516479 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0d2b19a1-39d5-43df-959c-3f8b9457e575 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:03.516936 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0d2b19a1-39d5-43df-959c-3f8b9457e575 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:03.521325 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0d2b19a1-39d5-43df-959c-3f8b9457e575 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:03.665983 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-0d2b19a1-39d5-43df-959c-3f8b9457e575 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:48:03.674810 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-0d2b19a1-39d5-43df-959c-3f8b9457e575 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/6e4576f1-35ce-4081-a2f1-e8e324a1c677" status: 200 len: 1265 microversion: 2.1 time: 0.172508 Nov 02 14:48:03.675383 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 420/862] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:48:03 2022] GET /compute/v2.1/servers/6e4576f1-35ce-4081-a2f1-e8e324a1c677 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:48:04.699728 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-23e55c60-a168-4c33-bc4f-73fc737374bd tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:04.701177 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-23e55c60-a168-4c33-bc4f-73fc737374bd tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: 6e4576f1-35ce-4081-a2f1-e8e324a1c677] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:04.715746 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-23e55c60-a168-4c33-bc4f-73fc737374bd tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:04.727997 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-23e55c60-a168-4c33-bc4f-73fc737374bd tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:04.727997 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-23e55c60-a168-4c33-bc4f-73fc737374bd tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:04.727997 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-23e55c60-a168-4c33-bc4f-73fc737374bd tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:04.727997 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-23e55c60-a168-4c33-bc4f-73fc737374bd tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:04.728424 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-23e55c60-a168-4c33-bc4f-73fc737374bd tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:04.966190 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-23e55c60-a168-4c33-bc4f-73fc737374bd tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:48:04.974861 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-23e55c60-a168-4c33-bc4f-73fc737374bd tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/6e4576f1-35ce-4081-a2f1-e8e324a1c677" status: 200 len: 1265 microversion: 2.1 time: 0.280050 Nov 02 14:48:04.975443 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 443/863] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:48:04 2022] GET /compute/v2.1/servers/6e4576f1-35ce-4081-a2f1-e8e324a1c677 => generated 1265 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:48:05.846657 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-7d7ae8a8-0308-46c2-b2da-89fabacafd70 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-292175365", "imageRef": "a726a246-cc7f-46e6-aeff-4d62e03cc091", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f4156324-b06b-4603-82b2-5bb54f75cf91"}], "security_groups": [{"name": "tempest-securitygroup--504796327"}], "key_name": "tempest-keypair-195435391", "user_data": "}} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:48:05.998364 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-603a224b-9228-4eb7-bd0e-bad488a1c3ea tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:05.998984 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-603a224b-9228-4eb7-bd0e-bad488a1c3ea tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: 6e4576f1-35ce-4081-a2f1-e8e324a1c677] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:06.007190 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-603a224b-9228-4eb7-bd0e-bad488a1c3ea tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:06.007682 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-603a224b-9228-4eb7-bd0e-bad488a1c3ea tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:06.008127 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-603a224b-9228-4eb7-bd0e-bad488a1c3ea tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:06.008844 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-603a224b-9228-4eb7-bd0e-bad488a1c3ea tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:06.009325 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-603a224b-9228-4eb7-bd0e-bad488a1c3ea tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:06.009754 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-603a224b-9228-4eb7-bd0e-bad488a1c3ea tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:06.255866 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.network.neutron [None req-7d7ae8a8-0308-46c2-b2da-89fabacafd70 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] validate_networks() for [('f4156324-b06b-4603-82b2-5bb54f75cf91', None, None, None, None, None)] {{(pid=119658) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:48:06.369897 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-603a224b-9228-4eb7-bd0e-bad488a1c3ea tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:48:06.378301 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-603a224b-9228-4eb7-bd0e-bad488a1c3ea tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/6e4576f1-35ce-4081-a2f1-e8e324a1c677" status: 200 len: 1452 microversion: 2.1 time: 0.383756 Nov 02 14:48:06.378876 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 444/864] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:48:05 2022] GET /compute/v2.1/servers/6e4576f1-35ce-4081-a2f1-e8e324a1c677 => generated 1452 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:48:06.402782 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-357c4ca9-3ab8-4128-8604-31df30c01b4b tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:06.403395 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-357c4ca9-3ab8-4128-8604-31df30c01b4b tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: 6e4576f1-35ce-4081-a2f1-e8e324a1c677] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:06.410733 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-357c4ca9-3ab8-4128-8604-31df30c01b4b tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:06.413488 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-357c4ca9-3ab8-4128-8604-31df30c01b4b tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:06.413488 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-357c4ca9-3ab8-4128-8604-31df30c01b4b tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:06.413488 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-357c4ca9-3ab8-4128-8604-31df30c01b4b tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:06.413488 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-357c4ca9-3ab8-4128-8604-31df30c01b4b tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:06.414373 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-357c4ca9-3ab8-4128-8604-31df30c01b4b tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:06.628040 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-357c4ca9-3ab8-4128-8604-31df30c01b4b tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:48:06.636586 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-357c4ca9-3ab8-4128-8604-31df30c01b4b tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/6e4576f1-35ce-4081-a2f1-e8e324a1c677" status: 200 len: 1452 microversion: 2.1 time: 0.237507 Nov 02 14:48:06.637262 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 445/865] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:48:06 2022] GET /compute/v2.1/servers/6e4576f1-35ce-4081-a2f1-e8e324a1c677 => generated 1452 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:48:06.751731 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-7d7ae8a8-0308-46c2-b2da-89fabacafd70 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Flavor limits 0:0:0 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:48:06.752167 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-7d7ae8a8-0308-46c2-b2da-89fabacafd70 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Image limits 0:0:0 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:48:06.752639 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-7d7ae8a8-0308-46c2-b2da-89fabacafd70 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Flavor pref 0:0:0 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:48:06.753300 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-7d7ae8a8-0308-46c2-b2da-89fabacafd70 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Image pref 0:0:0 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:48:06.753718 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-7d7ae8a8-0308-46c2-b2da-89fabacafd70 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:48:06.762744 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7d7ae8a8-0308-46c2-b2da-89fabacafd70 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:06.771589 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7d7ae8a8-0308-46c2-b2da-89fabacafd70 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:06.771589 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7d7ae8a8-0308-46c2-b2da-89fabacafd70 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:06.771589 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7d7ae8a8-0308-46c2-b2da-89fabacafd70 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:06.771589 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7d7ae8a8-0308-46c2-b2da-89fabacafd70 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:06.771958 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7d7ae8a8-0308-46c2-b2da-89fabacafd70 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:06.783476 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.quota [None req-7d7ae8a8-0308-46c2-b2da-89fabacafd70 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Getting quotas for project 2bf7381b1bf545c39936c96595aa36f4. Resources: {'instances', 'ram', 'cores'} {{(pid=119658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:48:06.787460 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.quota [None req-7d7ae8a8-0308-46c2-b2da-89fabacafd70 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Getting quotas for user 6069bdb19c5c42ff8546aef3197a6a2b and project 2bf7381b1bf545c39936c96595aa36f4. Resources: {'instances', 'ram', 'cores'} {{(pid=119658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:48:06.799800 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-7d7ae8a8-0308-46c2-b2da-89fabacafd70 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Going to run 1 instances... {{(pid=119658) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:48:06.802340 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-7d7ae8a8-0308-46c2-b2da-89fabacafd70 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a726a246-cc7f-46e6-aeff-4d62e03cc091',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119658) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:48:06.948798 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-7d7ae8a8-0308-46c2-b2da-89fabacafd70 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.106540 Nov 02 14:48:06.955645 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 421/866] 10.222.0.30 () {60 vars in 1147 bytes} [Wed Nov 2 14:48:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 1114 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:48:06.961045 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-b3418640-84dd-4319-a73f-53ce483cd32a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:06.961790 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-b3418640-84dd-4319-a73f-53ce483cd32a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:07.017722 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-b3418640-84dd-4319-a73f-53ce483cd32a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:48:07.025077 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-b3418640-84dd-4319-a73f-53ce483cd32a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3" status: 200 len: 1236 microversion: 2.1 time: 0.067845 Nov 02 14:48:07.029839 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 446/867] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:48:06 2022] GET /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3 => generated 1236 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:48:08.048924 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-c74681c5-c268-460a-8fbc-7bda8f7ffee6 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:08.049951 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-c74681c5-c268-460a-8fbc-7bda8f7ffee6 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:08.052629 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:48:08.059333 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c74681c5-c268-460a-8fbc-7bda8f7ffee6 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:08.059826 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c74681c5-c268-460a-8fbc-7bda8f7ffee6 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:08.060266 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c74681c5-c268-460a-8fbc-7bda8f7ffee6 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:08.061098 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c74681c5-c268-460a-8fbc-7bda8f7ffee6 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:08.061547 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c74681c5-c268-460a-8fbc-7bda8f7ffee6 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:08.062504 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c74681c5-c268-460a-8fbc-7bda8f7ffee6 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:08.133182 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-c74681c5-c268-460a-8fbc-7bda8f7ffee6 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:48:08.142502 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-c74681c5-c268-460a-8fbc-7bda8f7ffee6 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3" status: 200 len: 1240 microversion: 2.1 time: 0.098580 Nov 02 14:48:08.143117 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 422/868] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:48:08 2022] GET /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3 => generated 1240 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:48:08.872297 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [req-03646c25-d0a7-4442-8b58-2028a8db1c9c req-5359a3c9-6403-4b6c-9e03-687dc827c771 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e4576f1-35ce-4081-a2f1-e8e324a1c677", "tag": "c8c7d645-c149-4b30-8fb6-474b94827b54"}]} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:48:08.888707 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-03646c25-d0a7-4442-8b58-2028a8db1c9c req-5359a3c9-6403-4b6c-9e03-687dc827c771 service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:08.888707 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-03646c25-d0a7-4442-8b58-2028a8db1c9c req-5359a3c9-6403-4b6c-9e03-687dc827c771 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:08.888707 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-03646c25-d0a7-4442-8b58-2028a8db1c9c req-5359a3c9-6403-4b6c-9e03-687dc827c771 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:08.896282 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.compute.server_external_events [req-03646c25-d0a7-4442-8b58-2028a8db1c9c req-5359a3c9-6403-4b6c-9e03-687dc827c771 service nova] Creating event network-changed:c8c7d645-c149-4b30-8fb6-474b94827b54 for instance 6e4576f1-35ce-4081-a2f1-e8e324a1c677 on hv-cinder-86236 Nov 02 14:48:08.901347 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [req-03646c25-d0a7-4442-8b58-2028a8db1c9c req-5359a3c9-6403-4b6c-9e03-687dc827c771 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032772 Nov 02 14:48:08.902219 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 447/869] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:48:09.166060 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-465e2f67-bcf8-4b54-9675-dfa147cf0a90 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:09.166666 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-465e2f67-bcf8-4b54-9675-dfa147cf0a90 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:09.174232 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-465e2f67-bcf8-4b54-9675-dfa147cf0a90 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:09.174720 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-465e2f67-bcf8-4b54-9675-dfa147cf0a90 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:09.175245 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-465e2f67-bcf8-4b54-9675-dfa147cf0a90 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:09.175930 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-465e2f67-bcf8-4b54-9675-dfa147cf0a90 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:09.176477 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-465e2f67-bcf8-4b54-9675-dfa147cf0a90 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:09.176959 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-465e2f67-bcf8-4b54-9675-dfa147cf0a90 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:09.264724 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-465e2f67-bcf8-4b54-9675-dfa147cf0a90 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:48:09.274917 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-465e2f67-bcf8-4b54-9675-dfa147cf0a90 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3" status: 200 len: 1296 microversion: 2.1 time: 0.112694 Nov 02 14:48:09.276255 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 423/870] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:48:09 2022] GET /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3 => generated 1296 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:48:10.303524 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-875b6fe7-c476-491b-a54c-81c004f0b8ac tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:10.304243 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-875b6fe7-c476-491b-a54c-81c004f0b8ac tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:10.311012 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-875b6fe7-c476-491b-a54c-81c004f0b8ac tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:10.311522 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-875b6fe7-c476-491b-a54c-81c004f0b8ac tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:10.313060 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-875b6fe7-c476-491b-a54c-81c004f0b8ac tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:10.313999 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-875b6fe7-c476-491b-a54c-81c004f0b8ac tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:10.314472 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-875b6fe7-c476-491b-a54c-81c004f0b8ac tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:10.314910 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-875b6fe7-c476-491b-a54c-81c004f0b8ac tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:10.535558 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-875b6fe7-c476-491b-a54c-81c004f0b8ac tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:48:10.543391 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-875b6fe7-c476-491b-a54c-81c004f0b8ac tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3" status: 200 len: 1361 microversion: 2.1 time: 0.245480 Nov 02 14:48:10.544100 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 448/871] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:48:10 2022] GET /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3 => generated 1361 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:48:11.251015 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [req-d28b70ac-dbe7-4982-9fa7-0d8e2d416c40 req-a1397bac-aeee-4d1f-85c5-f624f5b7cf11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3", "tag": "d1638fe4-d11f-4f39-8b81-4f5434920e98"}]} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:48:11.265882 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-d28b70ac-dbe7-4982-9fa7-0d8e2d416c40 req-a1397bac-aeee-4d1f-85c5-f624f5b7cf11 service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:11.266576 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-d28b70ac-dbe7-4982-9fa7-0d8e2d416c40 req-a1397bac-aeee-4d1f-85c5-f624f5b7cf11 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:11.266874 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-d28b70ac-dbe7-4982-9fa7-0d8e2d416c40 req-a1397bac-aeee-4d1f-85c5-f624f5b7cf11 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:11.278321 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.compute.server_external_events [req-d28b70ac-dbe7-4982-9fa7-0d8e2d416c40 req-a1397bac-aeee-4d1f-85c5-f624f5b7cf11 service nova] Creating event network-changed:d1638fe4-d11f-4f39-8b81-4f5434920e98 for instance 34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3 on hv-cinder-86236 Nov 02 14:48:11.283798 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [req-d28b70ac-dbe7-4982-9fa7-0d8e2d416c40 req-a1397bac-aeee-4d1f-85c5-f624f5b7cf11 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040097 Nov 02 14:48:11.284495 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 424/872] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:48:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:48:11.569476 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-d7cb4d18-45a0-4266-972d-5de32b8cfeca tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:11.570285 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-d7cb4d18-45a0-4266-972d-5de32b8cfeca tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:11.578207 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d7cb4d18-45a0-4266-972d-5de32b8cfeca tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:11.578732 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d7cb4d18-45a0-4266-972d-5de32b8cfeca tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:11.579168 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d7cb4d18-45a0-4266-972d-5de32b8cfeca tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:11.579877 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d7cb4d18-45a0-4266-972d-5de32b8cfeca tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:11.580519 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d7cb4d18-45a0-4266-972d-5de32b8cfeca tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:11.581111 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d7cb4d18-45a0-4266-972d-5de32b8cfeca tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:11.779653 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-d7cb4d18-45a0-4266-972d-5de32b8cfeca tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:48:11.788089 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-d7cb4d18-45a0-4266-972d-5de32b8cfeca tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3" status: 200 len: 1361 microversion: 2.1 time: 0.223689 Nov 02 14:48:11.788675 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 449/873] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:48:11 2022] GET /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3 => generated 1361 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:48:12.818079 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-52a55dd9-576d-4fcc-a7c3-3be3a434f6bc tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:12.818783 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-52a55dd9-576d-4fcc-a7c3-3be3a434f6bc tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:12.825244 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-52a55dd9-576d-4fcc-a7c3-3be3a434f6bc tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:12.825748 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-52a55dd9-576d-4fcc-a7c3-3be3a434f6bc tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:12.826191 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-52a55dd9-576d-4fcc-a7c3-3be3a434f6bc tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:12.826899 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-52a55dd9-576d-4fcc-a7c3-3be3a434f6bc tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:12.827913 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-52a55dd9-576d-4fcc-a7c3-3be3a434f6bc tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:12.828361 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-52a55dd9-576d-4fcc-a7c3-3be3a434f6bc tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:12.991254 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-52a55dd9-576d-4fcc-a7c3-3be3a434f6bc tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:48:12.999566 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-52a55dd9-576d-4fcc-a7c3-3be3a434f6bc tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3" status: 200 len: 1361 microversion: 2.1 time: 0.186213 Nov 02 14:48:13.000578 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 425/874] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:48:12 2022] GET /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3 => generated 1361 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:48:14.023725 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-01203ca5-c95b-4920-a9ed-e51664efc7dd tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:14.024335 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-01203ca5-c95b-4920-a9ed-e51664efc7dd tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:14.032626 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-01203ca5-c95b-4920-a9ed-e51664efc7dd tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:14.033161 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-01203ca5-c95b-4920-a9ed-e51664efc7dd tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:14.033606 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-01203ca5-c95b-4920-a9ed-e51664efc7dd tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:14.034326 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-01203ca5-c95b-4920-a9ed-e51664efc7dd tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:14.034786 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-01203ca5-c95b-4920-a9ed-e51664efc7dd tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:14.035219 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-01203ca5-c95b-4920-a9ed-e51664efc7dd tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:14.178871 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-01203ca5-c95b-4920-a9ed-e51664efc7dd tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:48:14.187738 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-01203ca5-c95b-4920-a9ed-e51664efc7dd tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3" status: 200 len: 1361 microversion: 2.1 time: 0.167190 Nov 02 14:48:14.188301 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 450/875] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:48:14 2022] GET /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3 => generated 1361 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:48:15.215826 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-40a26701-c101-4f6a-a52f-d4f866eca1a8 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:15.216951 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-40a26701-c101-4f6a-a52f-d4f866eca1a8 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:15.227289 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-40a26701-c101-4f6a-a52f-d4f866eca1a8 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:15.228001 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-40a26701-c101-4f6a-a52f-d4f866eca1a8 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:15.228574 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-40a26701-c101-4f6a-a52f-d4f866eca1a8 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:15.229588 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-40a26701-c101-4f6a-a52f-d4f866eca1a8 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:15.230160 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-40a26701-c101-4f6a-a52f-d4f866eca1a8 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:15.230799 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-40a26701-c101-4f6a-a52f-d4f866eca1a8 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:15.395408 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-40a26701-c101-4f6a-a52f-d4f866eca1a8 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:48:15.409780 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-40a26701-c101-4f6a-a52f-d4f866eca1a8 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3" status: 200 len: 1361 microversion: 2.1 time: 0.200829 Nov 02 14:48:15.422919 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 426/876] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:48:15 2022] GET /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3 => generated 1361 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:48:16.447125 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-36554e96-ad2f-40a6-8d58-4fd5a1e87cae tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:16.447823 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-36554e96-ad2f-40a6-8d58-4fd5a1e87cae tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:16.455367 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-36554e96-ad2f-40a6-8d58-4fd5a1e87cae tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:16.455857 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-36554e96-ad2f-40a6-8d58-4fd5a1e87cae tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:16.456296 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-36554e96-ad2f-40a6-8d58-4fd5a1e87cae tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:16.457068 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-36554e96-ad2f-40a6-8d58-4fd5a1e87cae tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:16.457600 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-36554e96-ad2f-40a6-8d58-4fd5a1e87cae tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:16.458028 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-36554e96-ad2f-40a6-8d58-4fd5a1e87cae tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:16.611366 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-36554e96-ad2f-40a6-8d58-4fd5a1e87cae tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:48:16.620868 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-36554e96-ad2f-40a6-8d58-4fd5a1e87cae tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3" status: 200 len: 1361 microversion: 2.1 time: 0.177712 Nov 02 14:48:16.621687 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 451/877] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:48:16 2022] GET /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3 => generated 1361 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:48:17.343817 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [req-c802402a-574b-45c6-9001-aab0031f6e3d req-e1391986-7884-41fc-9534-0cff4bff21cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3", "name": "network-vif-plugged", "status": "completed", "tag": "d1638fe4-d11f-4f39-8b81-4f5434920e98"}]} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:48:17.349498 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell0:SELECT=2 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:48:17.352123 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell0:SELECT=6 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:48:17.355644 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-c802402a-574b-45c6-9001-aab0031f6e3d req-e1391986-7884-41fc-9534-0cff4bff21cc service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:17.356130 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-c802402a-574b-45c6-9001-aab0031f6e3d req-e1391986-7884-41fc-9534-0cff4bff21cc service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:17.356570 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-c802402a-574b-45c6-9001-aab0031f6e3d req-e1391986-7884-41fc-9534-0cff4bff21cc service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:17.370082 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.compute.server_external_events [req-c802402a-574b-45c6-9001-aab0031f6e3d req-e1391986-7884-41fc-9534-0cff4bff21cc service nova] Creating event network-vif-plugged:d1638fe4-d11f-4f39-8b81-4f5434920e98 for instance 34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3 on hv-cinder-86236 Nov 02 14:48:17.376102 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [req-c802402a-574b-45c6-9001-aab0031f6e3d req-e1391986-7884-41fc-9534-0cff4bff21cc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036060 Nov 02 14:48:17.386735 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 427/878] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:48:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:48:17.658218 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-9a4020a9-8669-4ebe-ae6b-08f379c9885e tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:17.658824 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-9a4020a9-8669-4ebe-ae6b-08f379c9885e tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:17.660802 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell0:SELECT=6 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:48:17.666024 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9a4020a9-8669-4ebe-ae6b-08f379c9885e tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:17.666505 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9a4020a9-8669-4ebe-ae6b-08f379c9885e tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:17.666945 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9a4020a9-8669-4ebe-ae6b-08f379c9885e tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:17.667643 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9a4020a9-8669-4ebe-ae6b-08f379c9885e tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:17.668099 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9a4020a9-8669-4ebe-ae6b-08f379c9885e tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:17.668523 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9a4020a9-8669-4ebe-ae6b-08f379c9885e tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:17.859934 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-9a4020a9-8669-4ebe-ae6b-08f379c9885e tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:48:17.868078 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-9a4020a9-8669-4ebe-ae6b-08f379c9885e tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3" status: 200 len: 1361 microversion: 2.1 time: 0.214077 Nov 02 14:48:17.868738 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 452/879] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:48:17 2022] GET /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3 => generated 1361 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:48:18.894371 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-12349ee5-aa9f-4860-bfbf-69aaa686161a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:18.894983 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-12349ee5-aa9f-4860-bfbf-69aaa686161a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:18.901870 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-12349ee5-aa9f-4860-bfbf-69aaa686161a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:18.902357 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-12349ee5-aa9f-4860-bfbf-69aaa686161a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:18.902794 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-12349ee5-aa9f-4860-bfbf-69aaa686161a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:18.903495 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-12349ee5-aa9f-4860-bfbf-69aaa686161a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:18.903947 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-12349ee5-aa9f-4860-bfbf-69aaa686161a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:18.904405 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-12349ee5-aa9f-4860-bfbf-69aaa686161a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:19.041645 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-12349ee5-aa9f-4860-bfbf-69aaa686161a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:48:19.050097 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-12349ee5-aa9f-4860-bfbf-69aaa686161a tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3" status: 200 len: 1361 microversion: 2.1 time: 0.161837 Nov 02 14:48:19.050674 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 428/880] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:48:18 2022] GET /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3 => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:48:20.074083 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-8170fa88-f4c0-4ece-845f-bcf7dec75d2e tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:20.074741 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-8170fa88-f4c0-4ece-845f-bcf7dec75d2e tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:20.082402 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8170fa88-f4c0-4ece-845f-bcf7dec75d2e tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:20.082890 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8170fa88-f4c0-4ece-845f-bcf7dec75d2e tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:20.083328 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8170fa88-f4c0-4ece-845f-bcf7dec75d2e tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:20.084033 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8170fa88-f4c0-4ece-845f-bcf7dec75d2e tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:20.084488 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8170fa88-f4c0-4ece-845f-bcf7dec75d2e tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:20.084909 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8170fa88-f4c0-4ece-845f-bcf7dec75d2e tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:20.226473 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-8170fa88-f4c0-4ece-845f-bcf7dec75d2e tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:48:20.234645 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-8170fa88-f4c0-4ece-845f-bcf7dec75d2e tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3" status: 200 len: 1547 microversion: 2.1 time: 0.164632 Nov 02 14:48:20.235235 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 453/881] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:48:20 2022] GET /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3 => generated 1547 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:48:20.257820 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-d6fa37c2-db7c-403e-8b51-cedfce3686d5 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:20.258411 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-d6fa37c2-db7c-403e-8b51-cedfce3686d5 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:20.264695 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d6fa37c2-db7c-403e-8b51-cedfce3686d5 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:20.265862 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d6fa37c2-db7c-403e-8b51-cedfce3686d5 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:20.266799 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d6fa37c2-db7c-403e-8b51-cedfce3686d5 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:20.266990 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d6fa37c2-db7c-403e-8b51-cedfce3686d5 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:20.267443 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d6fa37c2-db7c-403e-8b51-cedfce3686d5 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:20.267871 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d6fa37c2-db7c-403e-8b51-cedfce3686d5 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:20.350452 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-d6fa37c2-db7c-403e-8b51-cedfce3686d5 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096444 Nov 02 14:48:20.351057 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 429/882] 10.222.0.30 () {58 vars in 1275 bytes} [Wed Nov 2 14:48:20 2022] GET /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:48:21.323043 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [req-a989a941-5a2b-4884-8bf5-0e7aeff9a68e req-748d958b-0a8a-4d61-b582-da6f750602e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3", "tag": "d1638fe4-d11f-4f39-8b81-4f5434920e98"}]} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:48:21.333105 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-a989a941-5a2b-4884-8bf5-0e7aeff9a68e req-748d958b-0a8a-4d61-b582-da6f750602e9 service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:21.333576 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-a989a941-5a2b-4884-8bf5-0e7aeff9a68e req-748d958b-0a8a-4d61-b582-da6f750602e9 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:21.334003 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-a989a941-5a2b-4884-8bf5-0e7aeff9a68e req-748d958b-0a8a-4d61-b582-da6f750602e9 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:21.344890 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.compute.server_external_events [req-a989a941-5a2b-4884-8bf5-0e7aeff9a68e req-748d958b-0a8a-4d61-b582-da6f750602e9 service nova] Creating event network-changed:d1638fe4-d11f-4f39-8b81-4f5434920e98 for instance 34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3 on hv-cinder-86236 Nov 02 14:48:21.349954 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [req-a989a941-5a2b-4884-8bf5-0e7aeff9a68e req-748d958b-0a8a-4d61-b582-da6f750602e9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030523 Nov 02 14:48:21.350548 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 454/883] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:48:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:48:35.706341 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_api:SELECT=15 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:48:35.707210 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell1:SELECT=85 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:48:35.711468 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-d4a46b27-6533-4126-b335-4d1406353224 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:35.723488 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-d4a46b27-6533-4126-b335-4d1406353224 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 7a7f3c5c-5f77-4d84-bf07-f73e7929f286] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:35.723488 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d4a46b27-6533-4126-b335-4d1406353224 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:35.723488 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d4a46b27-6533-4126-b335-4d1406353224 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:35.723488 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d4a46b27-6533-4126-b335-4d1406353224 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:35.724062 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d4a46b27-6533-4126-b335-4d1406353224 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:35.724062 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d4a46b27-6533-4126-b335-4d1406353224 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:35.724062 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d4a46b27-6533-4126-b335-4d1406353224 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:35.752966 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-d4a46b27-6533-4126-b335-4d1406353224 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f3c5c-5f77-4d84-bf07-f73e7929f286/ips" status: 200 len: 149 microversion: 2.1 time: 0.048244 Nov 02 14:48:35.753620 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 430/884] 10.222.0.30 () {58 vars in 1248 bytes} [Wed Nov 2 14:48:35 2022] GET /compute/v2.1/servers/7a7f3c5c-5f77-4d84-bf07-f73e7929f286/ips => generated 149 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:48:35.765096 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:48:35.765880 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell1:SELECT=67 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:48:35.770460 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-ab4b12d8-dca3-4398-a353-5b73d18ded7f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6aa621aa-eb80-42f5-b4b5-9761efc1367d"}} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:48:35.773161 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-ab4b12d8-dca3-4398-a353-5b73d18ded7f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 7a7f3c5c-5f77-4d84-bf07-f73e7929f286] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:35.780237 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ab4b12d8-dca3-4398-a353-5b73d18ded7f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:35.780842 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ab4b12d8-dca3-4398-a353-5b73d18ded7f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:35.781326 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ab4b12d8-dca3-4398-a353-5b73d18ded7f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:35.781901 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ab4b12d8-dca3-4398-a353-5b73d18ded7f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:35.782350 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ab4b12d8-dca3-4398-a353-5b73d18ded7f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:35.782776 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ab4b12d8-dca3-4398-a353-5b73d18ded7f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:35.878715 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.wsgi [None req-ab4b12d8-dca3-4398-a353-5b73d18ded7f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] HTTP exception thrown: Invalid volume: volume 6aa621aa-eb80-42f5-b4b5-9761efc1367d is already attached to instances: 015a2580-2374-494d-a62d-8ea86c25b6d4 Nov 02 14:48:35.880767 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-ab4b12d8-dca3-4398-a353-5b73d18ded7f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Request method failure captured: Nov 02 14:48:35.880767 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: request: POST /compute/v2.1/servers/7a7f3c5c-5f77-4d84-bf07-f73e7929f286/os-volume_attachments HTTP/1.1 Nov 02 14:48:35.880767 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Accept: application/json Nov 02 14:48:35.880767 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Accept-Encoding: identity Nov 02 14:48:35.880767 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Connection: close Nov 02 14:48:35.880767 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Content-Length: 74 Nov 02 14:48:35.880767 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Content-Type: application/json Nov 02 14:48:35.880767 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Host: 10.222.0.30 Nov 02 14:48:35.880767 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Openstack-System-Scope: None Nov 02 14:48:35.880767 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: User-Agent: python-urllib3/1.26.12 Nov 02 14:48:35.880767 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Auth-Token: gAAAAABjYoLLvHsLbLP8fTVuFWPOl6OBOImR3Z5sy0YBc5pcdW4rsQGD2999fEEKagme5Rl64Y-6rgjuI819nWAO1ogYJFLnm9s-YT3gxgnSb4U1lYBBYG0Hxitg6Xb3tz5FVnIsGEbww8BWoFWN4RSJnQNLjjxID_ZFkIwIYop5btRshsuXhyM Nov 02 14:48:35.880767 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Domain-Id: None Nov 02 14:48:35.880767 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Domain-Name: None Nov 02 14:48:35.880767 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Identity-Status: Confirmed Nov 02 14:48:35.880767 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Is-Admin-Project: True Nov 02 14:48:35.880767 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Domain-Id: default Nov 02 14:48:35.880767 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Domain-Name: Default Nov 02 14:48:35.880767 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Id: e428f318654f446db48445e4570ae2d3 Nov 02 14:48:35.880767 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Name: tempest-AttachVolumeNegativeTest-1274711238 Nov 02 14:48:35.880767 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Role: reader,member Nov 02 14:48:35.880767 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Roles: reader,member Nov 02 14:48:35.883434 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e428f318654f446db48445e4570ae2d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e428f318654f446db48445e4570ae2d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e428f318654f446db48445e4570ae2d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e428f318654f446db48445e4570ae2d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:48:35.883434 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant: tempest-AttachVolumeNegativeTest-1274711238 Nov 02 14:48:35.883434 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant-Id: e428f318654f446db48445e4570ae2d3 Nov 02 14:48:35.883434 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1274711238 Nov 02 14:48:35.883434 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User: tempest-AttachVolumeNegativeTest-1274711238-project Nov 02 14:48:35.883434 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Domain-Id: default Nov 02 14:48:35.883434 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Domain-Name: Default Nov 02 14:48:35.883434 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Id: 7fa761a568644a9399d825498a51f054 Nov 02 14:48:35.883434 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Name: tempest-AttachVolumeNegativeTest-1274711238-project Nov 02 14:48:35.883434 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Nov 02 14:48:35.883434 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: {"volumeAttachment": {"volumeId": "6aa621aa-eb80-42f5-b4b5-9761efc1367d"}} Nov 02 14:48:35.883434 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: method: > Nov 02 14:48:35.885193 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: exception: Invalid volume: volume 6aa621aa-eb80-42f5-b4b5-9761efc1367d is already attached to instances: 015a2580-2374-494d-a62d-8ea86c25b6d4 Nov 02 14:48:35.885193 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: action_args: {'server_id': '7a7f3c5c-5f77-4d84-bf07-f73e7929f286', 'body': {'volumeAttachment': {'volumeId': '6aa621aa-eb80-42f5-b4b5-9761efc1367d'}}} Nov 02 14:48:35.885193 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:48:35.885193 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:48:35.885193 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Nov 02 14:48:35.885193 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Nov 02 14:48:35.885193 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 14:48:35.885193 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 14:48:35.885193 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Nov 02 14:48:35.885193 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 14:48:35.885193 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Nov 02 14:48:35.885193 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Nov 02 14:48:35.885193 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Nov 02 14:48:35.885193 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Nov 02 14:48:35.885193 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 6aa621aa-eb80-42f5-b4b5-9761efc1367d is already attached to instances: 015a2580-2374-494d-a62d-8ea86c25b6d4 Nov 02 14:48:35.885193 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:48:35.885193 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:48:35.885193 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:48:35.885193 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:48:35.887855 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:48:35.887855 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:48:35.887855 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:48:35.887855 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:48:35.887855 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:48:35.887855 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:48:35.887855 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:48:35.887855 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:48:35.887855 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:48:35.887855 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:48:35.887855 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:48:35.887855 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:48:35.887855 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Nov 02 14:48:35.887855 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Nov 02 14:48:35.887855 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 6aa621aa-eb80-42f5-b4b5-9761efc1367d is already attached to instances: 015a2580-2374-494d-a62d-8ea86c25b6d4 Nov 02 14:48:35.887855 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:48:35.887855 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:48:35.887855 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:48:35.887855 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:48:35.887855 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:48:35.891291 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:48:35.891291 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:48:35.891291 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:48:35.891291 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 6aa621aa-eb80-42f5-b4b5-9761efc1367d is already attached to instances: 015a2580-2374-494d-a62d-8ea86c25b6d4 Nov 02 14:48:35.891291 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:48:35.891291 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-ab4b12d8-dca3-4398-a353-5b73d18ded7f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Returning 400 to user: Invalid volume: volume 6aa621aa-eb80-42f5-b4b5-9761efc1367d is already attached to instances: 015a2580-2374-494d-a62d-8ea86c25b6d4 {{(pid=119659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:48:35.891291 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-ab4b12d8-dca3-4398-a353-5b73d18ded7f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "POST /compute/v2.1/servers/7a7f3c5c-5f77-4d84-bf07-f73e7929f286/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.119457 Nov 02 14:48:35.891291 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 455/885] 10.222.0.30 () {60 vars in 1323 bytes} [Wed Nov 2 14:48:35 2022] POST /compute/v2.1/servers/7a7f3c5c-5f77-4d84-bf07-f73e7929f286/os-volume_attachments => generated 174 bytes in 121 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 02 14:48:35.897969 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-4e86e287-98a0-4218-86c9-6cfe93629801 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:35.898669 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-4e86e287-98a0-4218-86c9-6cfe93629801 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 7a7f3c5c-5f77-4d84-bf07-f73e7929f286] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:35.905931 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4e86e287-98a0-4218-86c9-6cfe93629801 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:35.906420 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4e86e287-98a0-4218-86c9-6cfe93629801 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:35.906855 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4e86e287-98a0-4218-86c9-6cfe93629801 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:35.908068 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4e86e287-98a0-4218-86c9-6cfe93629801 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:35.908068 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4e86e287-98a0-4218-86c9-6cfe93629801 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:35.908484 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4e86e287-98a0-4218-86c9-6cfe93629801 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:35.938664 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-4e86e287-98a0-4218-86c9-6cfe93629801 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 7a7f3c5c-5f77-4d84-bf07-f73e7929f286] Going to try to terminate instance {{(pid=119658) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:48:36.189489 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-4e86e287-98a0-4218-86c9-6cfe93629801 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7a7f3c5c-5f77-4d84-bf07-f73e7929f286" status: 204 len: 0 microversion: 2.1 time: 0.295147 Nov 02 14:48:36.190272 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 431/886] 10.222.0.30 () {58 vars in 1239 bytes} [Wed Nov 2 14:48:35 2022] DELETE /compute/v2.1/servers/7a7f3c5c-5f77-4d84-bf07-f73e7929f286 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:48:36.200305 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-79779236-943b-4c45-b181-cb0353ce73d5 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:36.200921 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-79779236-943b-4c45-b181-cb0353ce73d5 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 7a7f3c5c-5f77-4d84-bf07-f73e7929f286] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:36.208124 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-79779236-943b-4c45-b181-cb0353ce73d5 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:36.208611 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-79779236-943b-4c45-b181-cb0353ce73d5 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:36.209070 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-79779236-943b-4c45-b181-cb0353ce73d5 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:36.209773 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-79779236-943b-4c45-b181-cb0353ce73d5 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:36.210223 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-79779236-943b-4c45-b181-cb0353ce73d5 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:36.210649 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-79779236-943b-4c45-b181-cb0353ce73d5 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:36.360459 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-79779236-943b-4c45-b181-cb0353ce73d5 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:48:36.368967 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-79779236-943b-4c45-b181-cb0353ce73d5 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f3c5c-5f77-4d84-bf07-f73e7929f286" status: 200 len: 1680 microversion: 2.1 time: 0.173662 Nov 02 14:48:36.369566 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 456/887] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:48:36 2022] GET /compute/v2.1/servers/7a7f3c5c-5f77-4d84-bf07-f73e7929f286 => generated 1680 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:48:37.411249 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-5714029e-0ea1-4bdc-a141-32becdfae2ac tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:37.411908 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-5714029e-0ea1-4bdc-a141-32becdfae2ac tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 7a7f3c5c-5f77-4d84-bf07-f73e7929f286] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:37.419738 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5714029e-0ea1-4bdc-a141-32becdfae2ac tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:37.420296 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5714029e-0ea1-4bdc-a141-32becdfae2ac tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:37.421707 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5714029e-0ea1-4bdc-a141-32becdfae2ac tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:37.422617 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5714029e-0ea1-4bdc-a141-32becdfae2ac tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:37.423238 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5714029e-0ea1-4bdc-a141-32becdfae2ac tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:37.423922 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5714029e-0ea1-4bdc-a141-32becdfae2ac tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:37.581211 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-5714029e-0ea1-4bdc-a141-32becdfae2ac tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:48:37.589784 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-5714029e-0ea1-4bdc-a141-32becdfae2ac tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f3c5c-5f77-4d84-bf07-f73e7929f286" status: 200 len: 1680 microversion: 2.1 time: 0.182827 Nov 02 14:48:37.590362 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 432/888] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:48:37 2022] GET /compute/v2.1/servers/7a7f3c5c-5f77-4d84-bf07-f73e7929f286 => generated 1680 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:48:38.646601 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-a4f30087-53b7-4f6e-bac6-b25197353d16 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:38.646601 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-a4f30087-53b7-4f6e-bac6-b25197353d16 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 7a7f3c5c-5f77-4d84-bf07-f73e7929f286] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:38.646601 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a4f30087-53b7-4f6e-bac6-b25197353d16 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:38.646601 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a4f30087-53b7-4f6e-bac6-b25197353d16 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:38.647609 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a4f30087-53b7-4f6e-bac6-b25197353d16 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:38.647609 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a4f30087-53b7-4f6e-bac6-b25197353d16 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:38.647609 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a4f30087-53b7-4f6e-bac6-b25197353d16 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:38.647609 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a4f30087-53b7-4f6e-bac6-b25197353d16 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:38.764268 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-a4f30087-53b7-4f6e-bac6-b25197353d16 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:48:38.777585 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-a4f30087-53b7-4f6e-bac6-b25197353d16 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f3c5c-5f77-4d84-bf07-f73e7929f286" status: 200 len: 1613 microversion: 2.1 time: 0.166194 Nov 02 14:48:38.779055 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 457/889] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:48:38 2022] GET /compute/v2.1/servers/7a7f3c5c-5f77-4d84-bf07-f73e7929f286 => generated 1613 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:48:39.021602 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [req-99bd8dc9-fb8f-4575-877c-06c0634edb88 req-3c24733c-e0e3-4b9a-a831-1ee00336c9da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a7f3c5c-5f77-4d84-bf07-f73e7929f286", "name": "network-vif-deleted", "tag": "b355b9c9-5fd6-4f56-bd5e-6f289f768f89"}]} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:48:39.041478 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-99bd8dc9-fb8f-4575-877c-06c0634edb88 req-3c24733c-e0e3-4b9a-a831-1ee00336c9da service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:39.042558 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-99bd8dc9-fb8f-4575-877c-06c0634edb88 req-3c24733c-e0e3-4b9a-a831-1ee00336c9da service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:39.043361 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-99bd8dc9-fb8f-4575-877c-06c0634edb88 req-3c24733c-e0e3-4b9a-a831-1ee00336c9da service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:39.067295 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.compute.server_external_events [req-99bd8dc9-fb8f-4575-877c-06c0634edb88 req-3c24733c-e0e3-4b9a-a831-1ee00336c9da service nova] Creating event network-vif-deleted:b355b9c9-5fd6-4f56-bd5e-6f289f768f89 for instance 7a7f3c5c-5f77-4d84-bf07-f73e7929f286 on hv-cinder-86236 Nov 02 14:48:39.075902 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [req-99bd8dc9-fb8f-4575-877c-06c0634edb88 req-3c24733c-e0e3-4b9a-a831-1ee00336c9da service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061898 Nov 02 14:48:39.076736 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 433/890] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:48:39.823789 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-6cb15546-5bf9-48ba-b485-1911ec65fc35 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:39.824669 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-6cb15546-5bf9-48ba-b485-1911ec65fc35 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 7a7f3c5c-5f77-4d84-bf07-f73e7929f286] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:39.835183 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6cb15546-5bf9-48ba-b485-1911ec65fc35 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:39.837077 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6cb15546-5bf9-48ba-b485-1911ec65fc35 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:39.837077 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6cb15546-5bf9-48ba-b485-1911ec65fc35 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:39.837922 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6cb15546-5bf9-48ba-b485-1911ec65fc35 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:39.838701 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6cb15546-5bf9-48ba-b485-1911ec65fc35 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:39.839429 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6cb15546-5bf9-48ba-b485-1911ec65fc35 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:39.899178 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6cb15546-5bf9-48ba-b485-1911ec65fc35 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:39.899949 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6cb15546-5bf9-48ba-b485-1911ec65fc35 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:39.904212 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6cb15546-5bf9-48ba-b485-1911ec65fc35 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:39.904212 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.objects.instance [None req-6cb15546-5bf9-48ba-b485-1911ec65fc35 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lazy-loading 'fault' on Instance uuid 7a7f3c5c-5f77-4d84-bf07-f73e7929f286 {{(pid=119659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:48:39.958419 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-6cb15546-5bf9-48ba-b485-1911ec65fc35 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:48:39.973849 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-6cb15546-5bf9-48ba-b485-1911ec65fc35 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f3c5c-5f77-4d84-bf07-f73e7929f286" status: 200 len: 1331 microversion: 2.1 time: 0.156053 Nov 02 14:48:39.974878 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 458/891] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:48:39 2022] GET /compute/v2.1/servers/7a7f3c5c-5f77-4d84-bf07-f73e7929f286 => generated 1331 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:48:41.018130 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-e5792c70-257a-4b1c-be57-fe1295f55b93 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:41.019085 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-e5792c70-257a-4b1c-be57-fe1295f55b93 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 7a7f3c5c-5f77-4d84-bf07-f73e7929f286] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:41.030530 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e5792c70-257a-4b1c-be57-fe1295f55b93 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:41.031330 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e5792c70-257a-4b1c-be57-fe1295f55b93 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:41.032132 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e5792c70-257a-4b1c-be57-fe1295f55b93 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:41.033424 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e5792c70-257a-4b1c-be57-fe1295f55b93 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:41.034174 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e5792c70-257a-4b1c-be57-fe1295f55b93 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:41.034858 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e5792c70-257a-4b1c-be57-fe1295f55b93 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:41.060400 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.wsgi [None req-e5792c70-257a-4b1c-be57-fe1295f55b93 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] HTTP exception thrown: Instance 7a7f3c5c-5f77-4d84-bf07-f73e7929f286 could not be found. Nov 02 14:48:41.063831 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-e5792c70-257a-4b1c-be57-fe1295f55b93 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Request method failure captured: Nov 02 14:48:41.063831 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: request: GET /compute/v2.1/servers/7a7f3c5c-5f77-4d84-bf07-f73e7929f286 HTTP/1.1 Nov 02 14:48:41.063831 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Accept: application/json Nov 02 14:48:41.063831 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Accept-Encoding: identity Nov 02 14:48:41.063831 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Connection: close Nov 02 14:48:41.063831 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Content-Length: 0 Nov 02 14:48:41.063831 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Content-Type: application/json Nov 02 14:48:41.063831 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Host: 10.222.0.30 Nov 02 14:48:41.063831 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Openstack-System-Scope: None Nov 02 14:48:41.063831 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: User-Agent: python-urllib3/1.26.12 Nov 02 14:48:41.063831 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Auth-Token: gAAAAABjYoLLvHsLbLP8fTVuFWPOl6OBOImR3Z5sy0YBc5pcdW4rsQGD2999fEEKagme5Rl64Y-6rgjuI819nWAO1ogYJFLnm9s-YT3gxgnSb4U1lYBBYG0Hxitg6Xb3tz5FVnIsGEbww8BWoFWN4RSJnQNLjjxID_ZFkIwIYop5btRshsuXhyM Nov 02 14:48:41.063831 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Domain-Id: None Nov 02 14:48:41.063831 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Domain-Name: None Nov 02 14:48:41.063831 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Identity-Status: Confirmed Nov 02 14:48:41.063831 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Is-Admin-Project: True Nov 02 14:48:41.063831 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Domain-Id: default Nov 02 14:48:41.063831 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Domain-Name: Default Nov 02 14:48:41.063831 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Id: e428f318654f446db48445e4570ae2d3 Nov 02 14:48:41.063831 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Name: tempest-AttachVolumeNegativeTest-1274711238 Nov 02 14:48:41.063831 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Role: reader,member Nov 02 14:48:41.063831 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Roles: reader,member Nov 02 14:48:41.065575 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e428f318654f446db48445e4570ae2d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e428f318654f446db48445e4570ae2d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e428f318654f446db48445e4570ae2d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e428f318654f446db48445e4570ae2d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:48:41.065575 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant: tempest-AttachVolumeNegativeTest-1274711238 Nov 02 14:48:41.065575 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant-Id: e428f318654f446db48445e4570ae2d3 Nov 02 14:48:41.065575 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1274711238 Nov 02 14:48:41.065575 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User: tempest-AttachVolumeNegativeTest-1274711238-project Nov 02 14:48:41.065575 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Domain-Id: default Nov 02 14:48:41.065575 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Domain-Name: Default Nov 02 14:48:41.065575 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Id: 7fa761a568644a9399d825498a51f054 Nov 02 14:48:41.065575 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Name: tempest-AttachVolumeNegativeTest-1274711238-project Nov 02 14:48:41.065575 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: method: > Nov 02 14:48:41.065575 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: exception: Instance 7a7f3c5c-5f77-4d84-bf07-f73e7929f286 could not be found. Nov 02 14:48:41.065575 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: action_args: {'id': '7a7f3c5c-5f77-4d84-bf07-f73e7929f286'} Nov 02 14:48:41.066683 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:48:41.066683 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:48:41.066683 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:48:41.066683 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:48:41.066683 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:48:41.066683 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:48:41.066683 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:48:41.066683 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:48:41.066683 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:48:41.066683 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:48:41.066683 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a7f3c5c-5f77-4d84-bf07-f73e7929f286 could not be found. Nov 02 14:48:41.066683 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:48:41.066683 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:48:41.066683 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:48:41.066683 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:48:41.066683 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:48:41.066683 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:48:41.066683 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:48:41.066683 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:48:41.066683 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:48:41.068342 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:48:41.068342 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:48:41.068342 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:48:41.068342 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:48:41.068342 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:48:41.068342 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:48:41.068342 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:48:41.068342 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a7f3c5c-5f77-4d84-bf07-f73e7929f286 could not be found. Nov 02 14:48:41.068342 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:48:41.068342 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:48:41.068342 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:48:41.068342 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:48:41.068342 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:48:41.068342 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:48:41.068342 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:48:41.068342 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:48:41.068342 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a7f3c5c-5f77-4d84-bf07-f73e7929f286 could not be found. Nov 02 14:48:41.068342 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:48:41.069909 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-e5792c70-257a-4b1c-be57-fe1295f55b93 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Returning 404 to user: Instance 7a7f3c5c-5f77-4d84-bf07-f73e7929f286 could not be found. {{(pid=119658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:48:41.069909 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-e5792c70-257a-4b1c-be57-fe1295f55b93 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f3c5c-5f77-4d84-bf07-f73e7929f286" status: 404 len: 111 microversion: 2.1 time: 0.056869 Nov 02 14:48:41.069909 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 434/892] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:48:41 2022] GET /compute/v2.1/servers/7a7f3c5c-5f77-4d84-bf07-f73e7929f286 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:48:41.079462 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-32cefe8d-b2ed-4741-bbf6-e196144aeb95 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '.version_select at 0x7fb24ed87310>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:41.164812 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-32cefe8d-b2ed-4741-bbf6-e196144aeb95 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1105590767" status: 202 len: 0 microversion: 2.1 time: 0.090738 Nov 02 14:48:41.165435 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 459/893] 10.222.0.30 () {58 vars in 1221 bytes} [Wed Nov 2 14:48:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1105590767 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:48:42.176352 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-f42844fa-e8cd-42b7-8343-cdc656268e03 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:42.183357 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-f42844fa-e8cd-42b7-8343-cdc656268e03 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 015a2580-2374-494d-a62d-8ea86c25b6d4] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:42.183861 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f42844fa-e8cd-42b7-8343-cdc656268e03 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:42.184362 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f42844fa-e8cd-42b7-8343-cdc656268e03 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:42.184813 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f42844fa-e8cd-42b7-8343-cdc656268e03 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:42.185703 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f42844fa-e8cd-42b7-8343-cdc656268e03 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:42.187527 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f42844fa-e8cd-42b7-8343-cdc656268e03 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:42.187996 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f42844fa-e8cd-42b7-8343-cdc656268e03 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:42.296106 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.objects.instance [None req-f42844fa-e8cd-42b7-8343-cdc656268e03 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lazy-loading 'services' on Instance uuid 015a2580-2374-494d-a62d-8ea86c25b6d4 {{(pid=119658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:48:42.523130 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-f42844fa-e8cd-42b7-8343-cdc656268e03 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "DELETE /compute/v2.1/servers/015a2580-2374-494d-a62d-8ea86c25b6d4/os-volume_attachments/6aa621aa-eb80-42f5-b4b5-9761efc1367d" status: 202 len: 0 microversion: 2.1 time: 0.352849 Nov 02 14:48:42.523739 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 435/894] 10.222.0.30 () {58 vars in 1416 bytes} [Wed Nov 2 14:48:42 2022] DELETE /compute/v2.1/servers/015a2580-2374-494d-a62d-8ea86c25b6d4/os-volume_attachments/6aa621aa-eb80-42f5-b4b5-9761efc1367d => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 14:48:42.535553 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-ee9a1a5d-05fb-46ce-81b4-f74354e07f8d tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:42.538296 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-ee9a1a5d-05fb-46ce-81b4-f74354e07f8d tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 015a2580-2374-494d-a62d-8ea86c25b6d4] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:42.547404 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ee9a1a5d-05fb-46ce-81b4-f74354e07f8d tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:42.547893 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ee9a1a5d-05fb-46ce-81b4-f74354e07f8d tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:42.548334 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ee9a1a5d-05fb-46ce-81b4-f74354e07f8d tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:42.549097 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ee9a1a5d-05fb-46ce-81b4-f74354e07f8d tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:42.549550 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ee9a1a5d-05fb-46ce-81b4-f74354e07f8d tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:42.549975 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ee9a1a5d-05fb-46ce-81b4-f74354e07f8d tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:42.585678 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-ee9a1a5d-05fb-46ce-81b4-f74354e07f8d tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/015a2580-2374-494d-a62d-8ea86c25b6d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057393 Nov 02 14:48:42.586301 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 460/895] 10.222.0.30 () {58 vars in 1302 bytes} [Wed Nov 2 14:48:42 2022] GET /compute/v2.1/servers/015a2580-2374-494d-a62d-8ea86c25b6d4/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:48:43.601730 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-099dcaf6-216e-4fcb-82f9-1f2174ae54c5 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:43.604666 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-099dcaf6-216e-4fcb-82f9-1f2174ae54c5 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 015a2580-2374-494d-a62d-8ea86c25b6d4] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:43.612347 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-099dcaf6-216e-4fcb-82f9-1f2174ae54c5 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:43.612848 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-099dcaf6-216e-4fcb-82f9-1f2174ae54c5 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:43.613324 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-099dcaf6-216e-4fcb-82f9-1f2174ae54c5 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:43.614067 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-099dcaf6-216e-4fcb-82f9-1f2174ae54c5 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:43.614533 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-099dcaf6-216e-4fcb-82f9-1f2174ae54c5 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:43.614997 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-099dcaf6-216e-4fcb-82f9-1f2174ae54c5 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:43.652099 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-099dcaf6-216e-4fcb-82f9-1f2174ae54c5 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/015a2580-2374-494d-a62d-8ea86c25b6d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056441 Nov 02 14:48:43.652685 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 436/896] 10.222.0.30 () {58 vars in 1302 bytes} [Wed Nov 2 14:48:43 2022] GET /compute/v2.1/servers/015a2580-2374-494d-a62d-8ea86c25b6d4/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:48:44.665627 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-51342e7b-f456-4b25-9990-6a3fcfe2ced8 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:44.667991 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-51342e7b-f456-4b25-9990-6a3fcfe2ced8 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 015a2580-2374-494d-a62d-8ea86c25b6d4] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:44.675741 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-51342e7b-f456-4b25-9990-6a3fcfe2ced8 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:44.676424 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-51342e7b-f456-4b25-9990-6a3fcfe2ced8 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:44.676974 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-51342e7b-f456-4b25-9990-6a3fcfe2ced8 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:44.677893 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-51342e7b-f456-4b25-9990-6a3fcfe2ced8 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:44.678465 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-51342e7b-f456-4b25-9990-6a3fcfe2ced8 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:44.679035 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-51342e7b-f456-4b25-9990-6a3fcfe2ced8 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:44.715488 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-51342e7b-f456-4b25-9990-6a3fcfe2ced8 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/015a2580-2374-494d-a62d-8ea86c25b6d4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053967 Nov 02 14:48:44.716285 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 461/897] 10.222.0.30 () {58 vars in 1302 bytes} [Wed Nov 2 14:48:44 2022] GET /compute/v2.1/servers/015a2580-2374-494d-a62d-8ea86c25b6d4/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 14:48:44.789632 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-52827627-a291-46e2-80f9-285cb33db050 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:44.790315 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-52827627-a291-46e2-80f9-285cb33db050 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 015a2580-2374-494d-a62d-8ea86c25b6d4] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:44.797469 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-52827627-a291-46e2-80f9-285cb33db050 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:44.797965 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-52827627-a291-46e2-80f9-285cb33db050 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:44.798400 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-52827627-a291-46e2-80f9-285cb33db050 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:44.799147 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-52827627-a291-46e2-80f9-285cb33db050 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:44.799598 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-52827627-a291-46e2-80f9-285cb33db050 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:44.800019 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-52827627-a291-46e2-80f9-285cb33db050 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:44.985322 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-52827627-a291-46e2-80f9-285cb33db050 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 015a2580-2374-494d-a62d-8ea86c25b6d4] Going to try to terminate instance {{(pid=119658) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:48:45.334782 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-52827627-a291-46e2-80f9-285cb33db050 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "DELETE /compute/v2.1/servers/015a2580-2374-494d-a62d-8ea86c25b6d4" status: 204 len: 0 microversion: 2.1 time: 0.548581 Nov 02 14:48:45.335421 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 437/898] 10.222.0.30 () {58 vars in 1239 bytes} [Wed Nov 2 14:48:44 2022] DELETE /compute/v2.1/servers/015a2580-2374-494d-a62d-8ea86c25b6d4 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:48:45.344182 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-33784e33-77b1-4eb0-871a-96efb3929edb tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:45.344917 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-33784e33-77b1-4eb0-871a-96efb3929edb tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 015a2580-2374-494d-a62d-8ea86c25b6d4] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:45.351376 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-33784e33-77b1-4eb0-871a-96efb3929edb tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:45.351935 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-33784e33-77b1-4eb0-871a-96efb3929edb tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:45.352409 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-33784e33-77b1-4eb0-871a-96efb3929edb tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:45.353278 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-33784e33-77b1-4eb0-871a-96efb3929edb tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:45.353772 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-33784e33-77b1-4eb0-871a-96efb3929edb tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:45.354223 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-33784e33-77b1-4eb0-871a-96efb3929edb tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:45.500932 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-33784e33-77b1-4eb0-871a-96efb3929edb tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:48:45.509531 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-33784e33-77b1-4eb0-871a-96efb3929edb tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/015a2580-2374-494d-a62d-8ea86c25b6d4" status: 200 len: 1680 microversion: 2.1 time: 0.169335 Nov 02 14:48:45.510339 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 462/899] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:48:45 2022] GET /compute/v2.1/servers/015a2580-2374-494d-a62d-8ea86c25b6d4 => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:48:46.535959 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-85516b5b-af4c-443a-8396-24c069227c31 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:46.536664 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-85516b5b-af4c-443a-8396-24c069227c31 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 015a2580-2374-494d-a62d-8ea86c25b6d4] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:46.543617 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-85516b5b-af4c-443a-8396-24c069227c31 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:46.544110 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-85516b5b-af4c-443a-8396-24c069227c31 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:46.544555 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-85516b5b-af4c-443a-8396-24c069227c31 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:46.545878 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-85516b5b-af4c-443a-8396-24c069227c31 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:46.546340 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-85516b5b-af4c-443a-8396-24c069227c31 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:46.546772 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-85516b5b-af4c-443a-8396-24c069227c31 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:46.696895 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-85516b5b-af4c-443a-8396-24c069227c31 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:48:46.705414 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-85516b5b-af4c-443a-8396-24c069227c31 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/015a2580-2374-494d-a62d-8ea86c25b6d4" status: 200 len: 1680 microversion: 2.1 time: 0.173706 Nov 02 14:48:46.705998 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 438/900] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:48:46 2022] GET /compute/v2.1/servers/015a2580-2374-494d-a62d-8ea86c25b6d4 => generated 1680 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:48:47.730024 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-0c46fd30-f837-4d29-8d69-74ff0e47d465 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:47.730634 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-0c46fd30-f837-4d29-8d69-74ff0e47d465 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 015a2580-2374-494d-a62d-8ea86c25b6d4] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:47.737087 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0c46fd30-f837-4d29-8d69-74ff0e47d465 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:47.737586 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0c46fd30-f837-4d29-8d69-74ff0e47d465 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:47.738024 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0c46fd30-f837-4d29-8d69-74ff0e47d465 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:47.738724 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0c46fd30-f837-4d29-8d69-74ff0e47d465 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:47.739175 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0c46fd30-f837-4d29-8d69-74ff0e47d465 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:47.739607 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0c46fd30-f837-4d29-8d69-74ff0e47d465 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:47.960319 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-0c46fd30-f837-4d29-8d69-74ff0e47d465 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:48:47.969179 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-0c46fd30-f837-4d29-8d69-74ff0e47d465 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/015a2580-2374-494d-a62d-8ea86c25b6d4" status: 200 len: 1680 microversion: 2.1 time: 0.243246 Nov 02 14:48:47.970041 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 463/901] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:48:47 2022] GET /compute/v2.1/servers/015a2580-2374-494d-a62d-8ea86c25b6d4 => generated 1680 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:48:48.238041 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [req-1e1825ac-18e9-4f17-881f-cd0dadd2ded9 req-b9eacba3-945c-4e73-8abc-a4d3fa62f475 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "015a2580-2374-494d-a62d-8ea86c25b6d4", "name": "network-vif-deleted", "tag": "1313078c-90cf-4898-bb7f-d746882578d0"}]} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:48:48.256051 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-1e1825ac-18e9-4f17-881f-cd0dadd2ded9 req-b9eacba3-945c-4e73-8abc-a4d3fa62f475 service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:48.257158 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-1e1825ac-18e9-4f17-881f-cd0dadd2ded9 req-b9eacba3-945c-4e73-8abc-a4d3fa62f475 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:48.258041 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-1e1825ac-18e9-4f17-881f-cd0dadd2ded9 req-b9eacba3-945c-4e73-8abc-a4d3fa62f475 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:48.274061 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.compute.server_external_events [req-1e1825ac-18e9-4f17-881f-cd0dadd2ded9 req-b9eacba3-945c-4e73-8abc-a4d3fa62f475 service nova] Creating event network-vif-deleted:1313078c-90cf-4898-bb7f-d746882578d0 for instance 015a2580-2374-494d-a62d-8ea86c25b6d4 on hv-cinder-86236 Nov 02 14:48:48.281243 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [req-1e1825ac-18e9-4f17-881f-cd0dadd2ded9 req-b9eacba3-945c-4e73-8abc-a4d3fa62f475 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051224 Nov 02 14:48:48.282409 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 439/902] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:48:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:48:48.993741 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-acc395af-2ebf-448a-b03f-3114c1a67a0b tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:48.994413 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-acc395af-2ebf-448a-b03f-3114c1a67a0b tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 015a2580-2374-494d-a62d-8ea86c25b6d4] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:49.001020 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-acc395af-2ebf-448a-b03f-3114c1a67a0b tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:49.001518 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-acc395af-2ebf-448a-b03f-3114c1a67a0b tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:49.001949 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-acc395af-2ebf-448a-b03f-3114c1a67a0b tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:49.002661 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-acc395af-2ebf-448a-b03f-3114c1a67a0b tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:49.003110 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-acc395af-2ebf-448a-b03f-3114c1a67a0b tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:49.003533 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-acc395af-2ebf-448a-b03f-3114c1a67a0b tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:49.038943 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-acc395af-2ebf-448a-b03f-3114c1a67a0b tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:49.039422 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-acc395af-2ebf-448a-b03f-3114c1a67a0b tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:49.039854 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-acc395af-2ebf-448a-b03f-3114c1a67a0b tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:49.040301 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.objects.instance [None req-acc395af-2ebf-448a-b03f-3114c1a67a0b tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lazy-loading 'fault' on Instance uuid 015a2580-2374-494d-a62d-8ea86c25b6d4 {{(pid=119659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:48:49.097626 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-acc395af-2ebf-448a-b03f-3114c1a67a0b tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:48:49.106091 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-acc395af-2ebf-448a-b03f-3114c1a67a0b tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/015a2580-2374-494d-a62d-8ea86c25b6d4" status: 200 len: 1331 microversion: 2.1 time: 0.116613 Nov 02 14:48:49.106725 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 464/903] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:48:48 2022] GET /compute/v2.1/servers/015a2580-2374-494d-a62d-8ea86c25b6d4 => generated 1331 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:48:50.132873 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-91c29c60-08f9-4d27-b7c6-7eec76ca8fa6 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:50.133807 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-91c29c60-08f9-4d27-b7c6-7eec76ca8fa6 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 015a2580-2374-494d-a62d-8ea86c25b6d4] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:50.142510 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-91c29c60-08f9-4d27-b7c6-7eec76ca8fa6 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:50.143051 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-91c29c60-08f9-4d27-b7c6-7eec76ca8fa6 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:50.143634 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-91c29c60-08f9-4d27-b7c6-7eec76ca8fa6 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:50.144485 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-91c29c60-08f9-4d27-b7c6-7eec76ca8fa6 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:50.144993 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-91c29c60-08f9-4d27-b7c6-7eec76ca8fa6 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:50.145504 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-91c29c60-08f9-4d27-b7c6-7eec76ca8fa6 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:50.164574 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.wsgi [None req-91c29c60-08f9-4d27-b7c6-7eec76ca8fa6 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] HTTP exception thrown: Instance 015a2580-2374-494d-a62d-8ea86c25b6d4 could not be found. Nov 02 14:48:50.164574 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-91c29c60-08f9-4d27-b7c6-7eec76ca8fa6 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Request method failure captured: Nov 02 14:48:50.164574 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: request: GET /compute/v2.1/servers/015a2580-2374-494d-a62d-8ea86c25b6d4 HTTP/1.1 Nov 02 14:48:50.164574 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Accept: application/json Nov 02 14:48:50.164574 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Accept-Encoding: identity Nov 02 14:48:50.164574 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Connection: close Nov 02 14:48:50.164574 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Content-Length: 0 Nov 02 14:48:50.164574 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Content-Type: application/json Nov 02 14:48:50.164574 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Host: 10.222.0.30 Nov 02 14:48:50.164574 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Openstack-System-Scope: None Nov 02 14:48:50.164574 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: User-Agent: python-urllib3/1.26.12 Nov 02 14:48:50.164574 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Auth-Token: gAAAAABjYoLLvHsLbLP8fTVuFWPOl6OBOImR3Z5sy0YBc5pcdW4rsQGD2999fEEKagme5Rl64Y-6rgjuI819nWAO1ogYJFLnm9s-YT3gxgnSb4U1lYBBYG0Hxitg6Xb3tz5FVnIsGEbww8BWoFWN4RSJnQNLjjxID_ZFkIwIYop5btRshsuXhyM Nov 02 14:48:50.164574 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Domain-Id: None Nov 02 14:48:50.164574 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Domain-Name: None Nov 02 14:48:50.164574 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Identity-Status: Confirmed Nov 02 14:48:50.164574 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Is-Admin-Project: True Nov 02 14:48:50.164574 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Domain-Id: default Nov 02 14:48:50.164574 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Domain-Name: Default Nov 02 14:48:50.164574 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Id: e428f318654f446db48445e4570ae2d3 Nov 02 14:48:50.164574 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Name: tempest-AttachVolumeNegativeTest-1274711238 Nov 02 14:48:50.164574 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Role: reader,member Nov 02 14:48:50.164574 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Roles: reader,member Nov 02 14:48:50.167229 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e428f318654f446db48445e4570ae2d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e428f318654f446db48445e4570ae2d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e428f318654f446db48445e4570ae2d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e428f318654f446db48445e4570ae2d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:48:50.167229 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant: tempest-AttachVolumeNegativeTest-1274711238 Nov 02 14:48:50.167229 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant-Id: e428f318654f446db48445e4570ae2d3 Nov 02 14:48:50.167229 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1274711238 Nov 02 14:48:50.167229 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User: tempest-AttachVolumeNegativeTest-1274711238-project Nov 02 14:48:50.167229 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Domain-Id: default Nov 02 14:48:50.167229 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Domain-Name: Default Nov 02 14:48:50.167229 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Id: 7fa761a568644a9399d825498a51f054 Nov 02 14:48:50.167229 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Name: tempest-AttachVolumeNegativeTest-1274711238-project Nov 02 14:48:50.167229 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: method: > Nov 02 14:48:50.167229 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: exception: Instance 015a2580-2374-494d-a62d-8ea86c25b6d4 could not be found. Nov 02 14:48:50.167229 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: action_args: {'id': '015a2580-2374-494d-a62d-8ea86c25b6d4'} Nov 02 14:48:50.168559 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:48:50.168559 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:48:50.168559 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:48:50.168559 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:48:50.168559 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:48:50.168559 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:48:50.168559 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:48:50.168559 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:48:50.168559 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:48:50.168559 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:48:50.168559 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 015a2580-2374-494d-a62d-8ea86c25b6d4 could not be found. Nov 02 14:48:50.168559 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:48:50.168559 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:48:50.168559 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:48:50.168559 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:48:50.168559 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:48:50.168559 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:48:50.168559 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:48:50.168559 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:48:50.168559 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:48:50.171028 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:48:50.171028 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:48:50.171028 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:48:50.171028 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:48:50.171028 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:48:50.171028 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:48:50.171028 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:48:50.171028 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 015a2580-2374-494d-a62d-8ea86c25b6d4 could not be found. Nov 02 14:48:50.171028 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:48:50.171028 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:48:50.171028 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:48:50.171028 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:48:50.171028 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:48:50.171028 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:48:50.171028 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:48:50.171028 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:48:50.171028 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 015a2580-2374-494d-a62d-8ea86c25b6d4 could not be found. Nov 02 14:48:50.171028 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:48:50.173226 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-91c29c60-08f9-4d27-b7c6-7eec76ca8fa6 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Returning 404 to user: Instance 015a2580-2374-494d-a62d-8ea86c25b6d4 could not be found. {{(pid=119658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:48:50.173226 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-91c29c60-08f9-4d27-b7c6-7eec76ca8fa6 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/015a2580-2374-494d-a62d-8ea86c25b6d4" status: 404 len: 111 microversion: 2.1 time: 0.035764 Nov 02 14:48:50.173226 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 440/904] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:48:50 2022] GET /compute/v2.1/servers/015a2580-2374-494d-a62d-8ea86c25b6d4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:48:50.175175 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-c11ac58c-0e04-416b-9158-aae0fcbbe70f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '.version_select at 0x7fb24eeab310>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:50.279104 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-c11ac58c-0e04-416b-9158-aae0fcbbe70f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-365832769" status: 202 len: 0 microversion: 2.1 time: 0.108954 Nov 02 14:48:50.279864 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 465/905] 10.222.0.30 () {58 vars in 1218 bytes} [Wed Nov 2 14:48:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-365832769 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 14:48:51.092348 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-5628c13b-6464-4a09-8284-3d603d7cd9fa tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Action: 'create', calling method: .version_select at 0x7fb24ece09d0>, body: {"keypair": {"name": "tempest-keypair-109845735", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIEL1Lf4a6JNNPAFsBVskZ4VoMMHiOMjlv9vpU0+bPlTXtZ4O27GJulvuLEABUBgdfKLQrW8xGDDOtkyyTsFj6Uu4vUufc5Ul39HbxlmgxmRcbP0XnUzcAeb/8rKaWGyWw=="}} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:48:51.108317 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.quota [None req-5628c13b-6464-4a09-8284-3d603d7cd9fa tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Getting quotas for project e428f318654f446db48445e4570ae2d3. Resources: {'key_pairs'} {{(pid=119658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:48:51.112625 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.quota [None req-5628c13b-6464-4a09-8284-3d603d7cd9fa tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Getting quotas for user 7fa761a568644a9399d825498a51f054 and project e428f318654f446db48445e4570ae2d3. Resources: {'key_pairs'} {{(pid=119658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:48:51.188424 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-5628c13b-6464-4a09-8284-3d603d7cd9fa tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.100079 Nov 02 14:48:51.189194 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 441/906] 10.222.0.30 () {60 vars in 1159 bytes} [Wed Nov 2 14:48:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:48:53.635237 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-e09f1dbb-67db-4b57-ba77-dca7f8e576a2 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-323003185", "imageRef": "a726a246-cc7f-46e6-aeff-4d62e03cc091", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d6bf9a07-46e7-4c2d-8535-e65644e316a0"}], "security_groups": [{"name": "tempest-securitygroup--656873461"}], "key_name": "tempest-keypair-109845735", "user_data": "}} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:48:53.750232 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.network.neutron [None req-e09f1dbb-67db-4b57-ba77-dca7f8e576a2 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] validate_networks() for [('d6bf9a07-46e7-4c2d-8535-e65644e316a0', None, None, None, None, None)] {{(pid=119659) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:48:54.168030 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.virt.hardware [None req-e09f1dbb-67db-4b57-ba77-dca7f8e576a2 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Flavor limits 0:0:0 {{(pid=119659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:48:54.168447 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.virt.hardware [None req-e09f1dbb-67db-4b57-ba77-dca7f8e576a2 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Image limits 0:0:0 {{(pid=119659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:48:54.168915 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.virt.hardware [None req-e09f1dbb-67db-4b57-ba77-dca7f8e576a2 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Flavor pref 0:0:0 {{(pid=119659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:48:54.169363 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.virt.hardware [None req-e09f1dbb-67db-4b57-ba77-dca7f8e576a2 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Image pref 0:0:0 {{(pid=119659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:48:54.169769 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.virt.hardware [None req-e09f1dbb-67db-4b57-ba77-dca7f8e576a2 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:48:54.179764 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e09f1dbb-67db-4b57-ba77-dca7f8e576a2 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:54.180242 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e09f1dbb-67db-4b57-ba77-dca7f8e576a2 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:54.180675 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e09f1dbb-67db-4b57-ba77-dca7f8e576a2 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:54.181427 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e09f1dbb-67db-4b57-ba77-dca7f8e576a2 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:54.181894 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e09f1dbb-67db-4b57-ba77-dca7f8e576a2 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:54.182311 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e09f1dbb-67db-4b57-ba77-dca7f8e576a2 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:54.200793 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.quota [None req-e09f1dbb-67db-4b57-ba77-dca7f8e576a2 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Getting quotas for project e428f318654f446db48445e4570ae2d3. Resources: {'instances', 'ram', 'cores'} {{(pid=119659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:48:54.205956 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.quota [None req-e09f1dbb-67db-4b57-ba77-dca7f8e576a2 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Getting quotas for user 7fa761a568644a9399d825498a51f054 and project e428f318654f446db48445e4570ae2d3. Resources: {'instances', 'ram', 'cores'} {{(pid=119659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:48:54.218869 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-e09f1dbb-67db-4b57-ba77-dca7f8e576a2 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Going to run 1 instances... {{(pid=119659) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:48:54.221226 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-e09f1dbb-67db-4b57-ba77-dca7f8e576a2 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 7865fba9-1731-407f-a709-d60f1432e269] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a726a246-cc7f-46e6-aeff-4d62e03cc091',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119659) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:48:54.359062 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-e09f1dbb-67db-4b57-ba77-dca7f8e576a2 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.728584 Nov 02 14:48:54.359894 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 466/907] 10.222.0.30 () {60 vars in 1147 bytes} [Wed Nov 2 14:48:53 2022] POST /compute/v2.1/servers => generated 401 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 14:48:54.374943 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-903e5082-f6be-4f64-b7b9-10e1e35b7c63 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:54.375754 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-903e5082-f6be-4f64-b7b9-10e1e35b7c63 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 7865fba9-1731-407f-a709-d60f1432e269] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:54.458376 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-903e5082-f6be-4f64-b7b9-10e1e35b7c63 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:48:54.467601 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-903e5082-f6be-4f64-b7b9-10e1e35b7c63 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/7865fba9-1731-407f-a709-d60f1432e269" status: 200 len: 1240 microversion: 2.1 time: 0.099233 Nov 02 14:48:54.481040 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 442/908] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:48:54 2022] GET /compute/v2.1/servers/7865fba9-1731-407f-a709-d60f1432e269 => generated 1240 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:48:55.496558 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-f49c64ab-b07b-46a4-ab41-12da75cd351c tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:55.497287 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-f49c64ab-b07b-46a4-ab41-12da75cd351c tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 7865fba9-1731-407f-a709-d60f1432e269] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:55.505174 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f49c64ab-b07b-46a4-ab41-12da75cd351c tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:55.505817 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f49c64ab-b07b-46a4-ab41-12da75cd351c tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:55.506358 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f49c64ab-b07b-46a4-ab41-12da75cd351c tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:55.507176 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f49c64ab-b07b-46a4-ab41-12da75cd351c tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:55.507718 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f49c64ab-b07b-46a4-ab41-12da75cd351c tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:55.508395 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f49c64ab-b07b-46a4-ab41-12da75cd351c tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:55.595205 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-f49c64ab-b07b-46a4-ab41-12da75cd351c tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:48:55.603762 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-f49c64ab-b07b-46a4-ab41-12da75cd351c tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/7865fba9-1731-407f-a709-d60f1432e269" status: 200 len: 1244 microversion: 2.1 time: 0.112447 Nov 02 14:48:55.604421 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 467/909] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:48:55 2022] GET /compute/v2.1/servers/7865fba9-1731-407f-a709-d60f1432e269 => generated 1244 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:48:56.629239 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-f1ae8740-875c-42c1-9282-02de5694a2dc tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:56.630166 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-f1ae8740-875c-42c1-9282-02de5694a2dc tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 7865fba9-1731-407f-a709-d60f1432e269] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:56.637450 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f1ae8740-875c-42c1-9282-02de5694a2dc tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:56.638055 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f1ae8740-875c-42c1-9282-02de5694a2dc tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:56.638509 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f1ae8740-875c-42c1-9282-02de5694a2dc tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:56.639983 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f1ae8740-875c-42c1-9282-02de5694a2dc tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:56.640457 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f1ae8740-875c-42c1-9282-02de5694a2dc tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:56.640898 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f1ae8740-875c-42c1-9282-02de5694a2dc tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:57.056132 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-f1ae8740-875c-42c1-9282-02de5694a2dc tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:48:57.071104 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-f1ae8740-875c-42c1-9282-02de5694a2dc tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/7865fba9-1731-407f-a709-d60f1432e269" status: 200 len: 1300 microversion: 2.1 time: 0.445903 Nov 02 14:48:57.081175 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 443/910] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:48:56 2022] GET /compute/v2.1/servers/7865fba9-1731-407f-a709-d60f1432e269 => generated 1300 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:48:57.502635 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-621cd043-c70a-4d2e-8c6f-e50d00228c46 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:57.503492 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-621cd043-c70a-4d2e-8c6f-e50d00228c46 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:57.510865 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-621cd043-c70a-4d2e-8c6f-e50d00228c46 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:57.515967 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-621cd043-c70a-4d2e-8c6f-e50d00228c46 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:57.515967 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-621cd043-c70a-4d2e-8c6f-e50d00228c46 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:57.515967 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-621cd043-c70a-4d2e-8c6f-e50d00228c46 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:57.515967 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-621cd043-c70a-4d2e-8c6f-e50d00228c46 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:57.516614 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-621cd043-c70a-4d2e-8c6f-e50d00228c46 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:57.540756 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-621cd043-c70a-4d2e-8c6f-e50d00228c46 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3/ips" status: 200 len: 146 microversion: 2.1 time: 0.042561 Nov 02 14:48:57.541372 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 468/911] 10.222.0.30 () {58 vars in 1248 bytes} [Wed Nov 2 14:48:57 2022] GET /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3/ips => generated 146 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:48:58.115782 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-3f67f441-2094-4085-b3df-917128e064e9 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:58.116706 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-3f67f441-2094-4085-b3df-917128e064e9 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 7865fba9-1731-407f-a709-d60f1432e269] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:58.128521 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3f67f441-2094-4085-b3df-917128e064e9 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:58.129422 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3f67f441-2094-4085-b3df-917128e064e9 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:58.130196 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3f67f441-2094-4085-b3df-917128e064e9 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:58.131451 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3f67f441-2094-4085-b3df-917128e064e9 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:58.132319 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3f67f441-2094-4085-b3df-917128e064e9 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:58.133101 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3f67f441-2094-4085-b3df-917128e064e9 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:58.384247 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-3f67f441-2094-4085-b3df-917128e064e9 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:48:58.402534 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-3f67f441-2094-4085-b3df-917128e064e9 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/7865fba9-1731-407f-a709-d60f1432e269" status: 200 len: 1365 microversion: 2.1 time: 0.293226 Nov 02 14:48:58.404105 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 444/912] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:48:58 2022] GET /compute/v2.1/servers/7865fba9-1731-407f-a709-d60f1432e269 => generated 1365 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:48:59.139854 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [req-8e4b5938-9a25-4424-88a2-8550c8df855f req-03b19f98-bead-43c3-851a-37cc7be109ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7865fba9-1731-407f-a709-d60f1432e269", "tag": "c155ea33-0bb7-4da9-8b7e-40ccb265ead9"}]} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:48:59.158155 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-8e4b5938-9a25-4424-88a2-8550c8df855f req-03b19f98-bead-43c3-851a-37cc7be109ae service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:59.158155 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-8e4b5938-9a25-4424-88a2-8550c8df855f req-03b19f98-bead-43c3-851a-37cc7be109ae service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:59.158155 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-8e4b5938-9a25-4424-88a2-8550c8df855f req-03b19f98-bead-43c3-851a-37cc7be109ae service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:59.171314 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.compute.server_external_events [req-8e4b5938-9a25-4424-88a2-8550c8df855f req-03b19f98-bead-43c3-851a-37cc7be109ae service nova] Creating event network-changed:c155ea33-0bb7-4da9-8b7e-40ccb265ead9 for instance 7865fba9-1731-407f-a709-d60f1432e269 on hv-cinder-86236 Nov 02 14:48:59.176733 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [req-8e4b5938-9a25-4424-88a2-8550c8df855f req-03b19f98-bead-43c3-851a-37cc7be109ae service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044229 Nov 02 14:48:59.181149 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 469/913] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:48:59.438672 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-325908f8-8279-4a5d-a032-0ea0f005ac2d tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0a22a82b-c841-4b4d-8d35-057a02395b43"}} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:48:59.442980 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-325908f8-8279-4a5d-a032-0ea0f005ac2d tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:59.447552 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-1e13c5e8-e6e1-429e-b85b-11daf9661bff tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:59.448751 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-1e13c5e8-e6e1-429e-b85b-11daf9661bff tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 7865fba9-1731-407f-a709-d60f1432e269] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:59.454074 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-325908f8-8279-4a5d-a032-0ea0f005ac2d tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:59.454905 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-325908f8-8279-4a5d-a032-0ea0f005ac2d tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:59.455645 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-325908f8-8279-4a5d-a032-0ea0f005ac2d tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:59.456860 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-325908f8-8279-4a5d-a032-0ea0f005ac2d tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:59.457726 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-325908f8-8279-4a5d-a032-0ea0f005ac2d tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:59.458413 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-325908f8-8279-4a5d-a032-0ea0f005ac2d tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:59.460157 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1e13c5e8-e6e1-429e-b85b-11daf9661bff tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:59.460991 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1e13c5e8-e6e1-429e-b85b-11daf9661bff tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:59.461774 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1e13c5e8-e6e1-429e-b85b-11daf9661bff tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:59.463009 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1e13c5e8-e6e1-429e-b85b-11daf9661bff tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:59.463868 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1e13c5e8-e6e1-429e-b85b-11daf9661bff tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:59.464775 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1e13c5e8-e6e1-429e-b85b-11daf9661bff tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:59.751155 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-1e13c5e8-e6e1-429e-b85b-11daf9661bff tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:48:59.759946 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-1e13c5e8-e6e1-429e-b85b-11daf9661bff tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/7865fba9-1731-407f-a709-d60f1432e269" status: 200 len: 1365 microversion: 2.1 time: 0.320730 Nov 02 14:48:59.760592 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 470/914] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:48:59 2022] GET /compute/v2.1/servers/7865fba9-1731-407f-a709-d60f1432e269 => generated 1365 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:49:00.339246 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-325908f8-8279-4a5d-a032-0ea0f005ac2d tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "POST /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.908587 Nov 02 14:49:00.339788 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 445/915] 10.222.0.30 () {60 vars in 1323 bytes} [Wed Nov 2 14:48:59 2022] POST /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3/os-volume_attachments => generated 194 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:49:00.784767 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-2887e88b-eadb-4610-b09b-2c02da0df3f4 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:49:00.785528 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-2887e88b-eadb-4610-b09b-2c02da0df3f4 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 7865fba9-1731-407f-a709-d60f1432e269] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:49:00.794449 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2887e88b-eadb-4610-b09b-2c02da0df3f4 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:00.795631 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2887e88b-eadb-4610-b09b-2c02da0df3f4 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:00.796159 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2887e88b-eadb-4610-b09b-2c02da0df3f4 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:00.797034 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2887e88b-eadb-4610-b09b-2c02da0df3f4 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:00.797601 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2887e88b-eadb-4610-b09b-2c02da0df3f4 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:00.798086 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2887e88b-eadb-4610-b09b-2c02da0df3f4 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:00.954819 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-2887e88b-eadb-4610-b09b-2c02da0df3f4 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:49:00.963169 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-2887e88b-eadb-4610-b09b-2c02da0df3f4 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/7865fba9-1731-407f-a709-d60f1432e269" status: 200 len: 1365 microversion: 2.1 time: 0.183528 Nov 02 14:49:00.963911 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 471/916] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:49:00 2022] GET /compute/v2.1/servers/7865fba9-1731-407f-a709-d60f1432e269 => generated 1365 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:49:01.990388 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-6900f8f2-736c-4999-8d91-d80ac073965f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:49:01.991535 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-6900f8f2-736c-4999-8d91-d80ac073965f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 7865fba9-1731-407f-a709-d60f1432e269] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:49:02.003860 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6900f8f2-736c-4999-8d91-d80ac073965f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:02.005174 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6900f8f2-736c-4999-8d91-d80ac073965f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:02.005999 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6900f8f2-736c-4999-8d91-d80ac073965f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:02.007365 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6900f8f2-736c-4999-8d91-d80ac073965f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:02.007992 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6900f8f2-736c-4999-8d91-d80ac073965f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:02.008753 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6900f8f2-736c-4999-8d91-d80ac073965f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:02.020291 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:49:02.223722 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-6900f8f2-736c-4999-8d91-d80ac073965f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:49:02.233934 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-6900f8f2-736c-4999-8d91-d80ac073965f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/7865fba9-1731-407f-a709-d60f1432e269" status: 200 len: 1365 microversion: 2.1 time: 0.249607 Nov 02 14:49:02.234820 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 446/917] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:49:01 2022] GET /compute/v2.1/servers/7865fba9-1731-407f-a709-d60f1432e269 => generated 1365 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:49:03.261621 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-de911950-4d98-4e2c-8807-d2286066ae47 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:49:03.262873 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-de911950-4d98-4e2c-8807-d2286066ae47 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 7865fba9-1731-407f-a709-d60f1432e269] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:49:03.268927 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-de911950-4d98-4e2c-8807-d2286066ae47 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:03.269446 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-de911950-4d98-4e2c-8807-d2286066ae47 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:03.269879 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-de911950-4d98-4e2c-8807-d2286066ae47 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:03.270583 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-de911950-4d98-4e2c-8807-d2286066ae47 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:03.271030 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-de911950-4d98-4e2c-8807-d2286066ae47 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:03.271475 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-de911950-4d98-4e2c-8807-d2286066ae47 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:03.428703 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-de911950-4d98-4e2c-8807-d2286066ae47 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:49:03.437333 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-de911950-4d98-4e2c-8807-d2286066ae47 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/7865fba9-1731-407f-a709-d60f1432e269" status: 200 len: 1365 microversion: 2.1 time: 0.179588 Nov 02 14:49:03.437910 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 472/918] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:49:03 2022] GET /compute/v2.1/servers/7865fba9-1731-407f-a709-d60f1432e269 => generated 1365 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:49:04.460544 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-d4c0f779-a243-43a7-9b5a-90e667a07ec5 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:49:04.461219 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-d4c0f779-a243-43a7-9b5a-90e667a07ec5 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 7865fba9-1731-407f-a709-d60f1432e269] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:49:04.464745 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell0:SELECT=6 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:49:04.469769 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d4c0f779-a243-43a7-9b5a-90e667a07ec5 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:04.470263 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d4c0f779-a243-43a7-9b5a-90e667a07ec5 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:04.470702 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d4c0f779-a243-43a7-9b5a-90e667a07ec5 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:04.471428 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d4c0f779-a243-43a7-9b5a-90e667a07ec5 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:04.471887 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d4c0f779-a243-43a7-9b5a-90e667a07ec5 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:04.472450 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-d4c0f779-a243-43a7-9b5a-90e667a07ec5 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:04.621038 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-d4c0f779-a243-43a7-9b5a-90e667a07ec5 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:49:04.629573 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-d4c0f779-a243-43a7-9b5a-90e667a07ec5 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/7865fba9-1731-407f-a709-d60f1432e269" status: 200 len: 1365 microversion: 2.1 time: 0.172974 Nov 02 14:49:04.630151 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 447/919] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:49:04 2022] GET /compute/v2.1/servers/7865fba9-1731-407f-a709-d60f1432e269 => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:49:05.463013 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [req-bdf72090-5a82-4597-9da2-c28c1f7ea773 req-edc59a28-082a-4529-8c71-c18093d795bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7865fba9-1731-407f-a709-d60f1432e269", "name": "network-vif-plugged", "status": "completed", "tag": "c155ea33-0bb7-4da9-8b7e-40ccb265ead9"}]} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:49:05.472026 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell0:SELECT=2 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:49:05.472937 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell0:SELECT=6 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:49:05.478050 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-bdf72090-5a82-4597-9da2-c28c1f7ea773 req-edc59a28-082a-4529-8c71-c18093d795bd service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:05.478690 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-bdf72090-5a82-4597-9da2-c28c1f7ea773 req-edc59a28-082a-4529-8c71-c18093d795bd service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:05.479232 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-bdf72090-5a82-4597-9da2-c28c1f7ea773 req-edc59a28-082a-4529-8c71-c18093d795bd service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:05.495090 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.compute.server_external_events [req-bdf72090-5a82-4597-9da2-c28c1f7ea773 req-edc59a28-082a-4529-8c71-c18093d795bd service nova] Creating event network-vif-plugged:c155ea33-0bb7-4da9-8b7e-40ccb265ead9 for instance 7865fba9-1731-407f-a709-d60f1432e269 on hv-cinder-86236 Nov 02 14:49:05.500473 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [req-bdf72090-5a82-4597-9da2-c28c1f7ea773 req-edc59a28-082a-4529-8c71-c18093d795bd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042017 Nov 02 14:49:05.501110 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 473/920] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:49:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:49:05.658642 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-1126f876-06a8-49bd-a270-9d13d96aa258 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:49:05.659706 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-1126f876-06a8-49bd-a270-9d13d96aa258 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 7865fba9-1731-407f-a709-d60f1432e269] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:49:05.670632 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1126f876-06a8-49bd-a270-9d13d96aa258 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:05.671408 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1126f876-06a8-49bd-a270-9d13d96aa258 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:05.672198 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1126f876-06a8-49bd-a270-9d13d96aa258 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:05.673527 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1126f876-06a8-49bd-a270-9d13d96aa258 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:05.674366 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1126f876-06a8-49bd-a270-9d13d96aa258 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:05.675134 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1126f876-06a8-49bd-a270-9d13d96aa258 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:05.871657 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-1126f876-06a8-49bd-a270-9d13d96aa258 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:49:05.882729 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-1126f876-06a8-49bd-a270-9d13d96aa258 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/7865fba9-1731-407f-a709-d60f1432e269" status: 200 len: 1365 microversion: 2.1 time: 0.232113 Nov 02 14:49:05.883461 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 448/921] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:49:05 2022] GET /compute/v2.1/servers/7865fba9-1731-407f-a709-d60f1432e269 => generated 1365 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:49:06.912472 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-15c631eb-3541-48ae-96b1-4972e4f4469b tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:49:06.913805 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-15c631eb-3541-48ae-96b1-4972e4f4469b tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 7865fba9-1731-407f-a709-d60f1432e269] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:49:06.918272 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_api:SELECT=58,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:49:06.929837 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-15c631eb-3541-48ae-96b1-4972e4f4469b tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:06.930643 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-15c631eb-3541-48ae-96b1-4972e4f4469b tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:06.931378 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-15c631eb-3541-48ae-96b1-4972e4f4469b tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:06.932560 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-15c631eb-3541-48ae-96b1-4972e4f4469b tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:06.933348 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-15c631eb-3541-48ae-96b1-4972e4f4469b tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:06.934084 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-15c631eb-3541-48ae-96b1-4972e4f4469b tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:06.942319 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell1:SELECT=93 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:49:07.116798 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-15c631eb-3541-48ae-96b1-4972e4f4469b tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:49:07.127896 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-15c631eb-3541-48ae-96b1-4972e4f4469b tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/7865fba9-1731-407f-a709-d60f1432e269" status: 200 len: 1365 microversion: 2.1 time: 0.223855 Nov 02 14:49:07.130109 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 474/922] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:49:06 2022] GET /compute/v2.1/servers/7865fba9-1731-407f-a709-d60f1432e269 => generated 1365 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:49:08.161809 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-2f9acd3d-e78e-40f2-8c04-bca3e1b71497 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:49:08.162469 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-2f9acd3d-e78e-40f2-8c04-bca3e1b71497 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 7865fba9-1731-407f-a709-d60f1432e269] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:49:08.164870 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:49:08.170608 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2f9acd3d-e78e-40f2-8c04-bca3e1b71497 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:08.171197 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2f9acd3d-e78e-40f2-8c04-bca3e1b71497 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:08.171650 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2f9acd3d-e78e-40f2-8c04-bca3e1b71497 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:08.172404 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2f9acd3d-e78e-40f2-8c04-bca3e1b71497 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:08.172872 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2f9acd3d-e78e-40f2-8c04-bca3e1b71497 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:08.173345 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2f9acd3d-e78e-40f2-8c04-bca3e1b71497 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:08.347965 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-2f9acd3d-e78e-40f2-8c04-bca3e1b71497 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:49:08.356537 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-2f9acd3d-e78e-40f2-8c04-bca3e1b71497 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/7865fba9-1731-407f-a709-d60f1432e269" status: 200 len: 1554 microversion: 2.1 time: 0.198707 Nov 02 14:49:08.357713 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 449/923] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:49:08 2022] GET /compute/v2.1/servers/7865fba9-1731-407f-a709-d60f1432e269 => generated 1554 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:49:08.383118 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-cbaf62b3-774d-45e7-944e-c8c450028563 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:49:08.383970 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-cbaf62b3-774d-45e7-944e-c8c450028563 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 7865fba9-1731-407f-a709-d60f1432e269] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:49:08.392065 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-cbaf62b3-774d-45e7-944e-c8c450028563 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:08.392844 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-cbaf62b3-774d-45e7-944e-c8c450028563 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:08.393091 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-cbaf62b3-774d-45e7-944e-c8c450028563 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:08.393841 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-cbaf62b3-774d-45e7-944e-c8c450028563 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:08.394312 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-cbaf62b3-774d-45e7-944e-c8c450028563 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:08.394745 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-cbaf62b3-774d-45e7-944e-c8c450028563 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:08.497532 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-cbaf62b3-774d-45e7-944e-c8c450028563 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/7865fba9-1731-407f-a709-d60f1432e269/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.118900 Nov 02 14:49:08.501716 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 475/924] 10.222.0.30 () {58 vars in 1275 bytes} [Wed Nov 2 14:49:08 2022] GET /compute/v2.1/servers/7865fba9-1731-407f-a709-d60f1432e269/os-interface => generated 284 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:49:09.150331 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-7f21753f-142d-42b3-b5c2-5e5ec78e20ea tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:49:09.152781 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-7f21753f-142d-42b3-b5c2-5e5ec78e20ea tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:49:09.159664 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7f21753f-142d-42b3-b5c2-5e5ec78e20ea tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:09.160189 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7f21753f-142d-42b3-b5c2-5e5ec78e20ea tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:09.160638 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7f21753f-142d-42b3-b5c2-5e5ec78e20ea tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:09.161464 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7f21753f-142d-42b3-b5c2-5e5ec78e20ea tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:09.161928 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7f21753f-142d-42b3-b5c2-5e5ec78e20ea tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:09.162525 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7f21753f-142d-42b3-b5c2-5e5ec78e20ea tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:09.198106 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-7f21753f-142d-42b3-b5c2-5e5ec78e20ea tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051867 Nov 02 14:49:09.204171 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 450/925] 10.222.0.30 () {58 vars in 1302 bytes} [Wed Nov 2 14:49:09 2022] GET /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:49:09.215192 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-fc4b6aa5-9dd8-4697-8c28-1b3e86188804 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:49:09.215926 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-fc4b6aa5-9dd8-4697-8c28-1b3e86188804 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:49:09.224269 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fc4b6aa5-9dd8-4697-8c28-1b3e86188804 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:09.225044 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fc4b6aa5-9dd8-4697-8c28-1b3e86188804 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:09.225608 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fc4b6aa5-9dd8-4697-8c28-1b3e86188804 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:09.226452 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fc4b6aa5-9dd8-4697-8c28-1b3e86188804 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:09.227402 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fc4b6aa5-9dd8-4697-8c28-1b3e86188804 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:09.230727 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fc4b6aa5-9dd8-4697-8c28-1b3e86188804 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:09.274351 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-fc4b6aa5-9dd8-4697-8c28-1b3e86188804 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3/os-volume_attachments/0a22a82b-c841-4b4d-8d35-057a02395b43" status: 200 len: 194 microversion: 2.1 time: 0.063946 Nov 02 14:49:09.275552 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 476/926] 10.222.0.30 () {58 vars in 1413 bytes} [Wed Nov 2 14:49:09 2022] GET /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3/os-volume_attachments/0a22a82b-c841-4b4d-8d35-057a02395b43 => generated 194 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:49:09.792517 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [req-b172f2a8-16a0-4f2f-9297-e00dccdeb06f req-fd7eb770-8ebd-4999-92bb-4ae83137bcb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7865fba9-1731-407f-a709-d60f1432e269", "tag": "c155ea33-0bb7-4da9-8b7e-40ccb265ead9"}]} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:49:09.805137 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-b172f2a8-16a0-4f2f-9297-e00dccdeb06f req-fd7eb770-8ebd-4999-92bb-4ae83137bcb2 service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:09.805865 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-b172f2a8-16a0-4f2f-9297-e00dccdeb06f req-fd7eb770-8ebd-4999-92bb-4ae83137bcb2 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:09.806642 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-b172f2a8-16a0-4f2f-9297-e00dccdeb06f req-fd7eb770-8ebd-4999-92bb-4ae83137bcb2 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:09.824870 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.compute.server_external_events [req-b172f2a8-16a0-4f2f-9297-e00dccdeb06f req-fd7eb770-8ebd-4999-92bb-4ae83137bcb2 service nova] Creating event network-changed:c155ea33-0bb7-4da9-8b7e-40ccb265ead9 for instance 7865fba9-1731-407f-a709-d60f1432e269 on hv-cinder-86236 Nov 02 14:49:09.831247 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [req-b172f2a8-16a0-4f2f-9297-e00dccdeb06f req-fd7eb770-8ebd-4999-92bb-4ae83137bcb2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043139 Nov 02 14:49:09.832154 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 451/927] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:49:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:49:11.084792 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-76b2c3aa-eef8-49a6-b79a-bf89701d1472 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "82f24355-1412-484a-a36a-aa4a95eea2d2"}} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:49:11.088064 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-76b2c3aa-eef8-49a6-b79a-bf89701d1472 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:49:11.096605 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-76b2c3aa-eef8-49a6-b79a-bf89701d1472 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:11.103564 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-76b2c3aa-eef8-49a6-b79a-bf89701d1472 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:11.103564 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-76b2c3aa-eef8-49a6-b79a-bf89701d1472 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:11.103564 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-76b2c3aa-eef8-49a6-b79a-bf89701d1472 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:11.103564 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-76b2c3aa-eef8-49a6-b79a-bf89701d1472 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:11.104076 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-76b2c3aa-eef8-49a6-b79a-bf89701d1472 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:11.912389 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-76b2c3aa-eef8-49a6-b79a-bf89701d1472 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "POST /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.831864 Nov 02 14:49:11.913305 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 477/928] 10.222.0.30 () {60 vars in 1323 bytes} [Wed Nov 2 14:49:11 2022] POST /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3/os-volume_attachments => generated 194 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:49:19.580223 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-14207313-e09a-4e94-bcd2-6f133874002d tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:49:19.584671 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-14207313-e09a-4e94-bcd2-6f133874002d tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:49:19.596660 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-14207313-e09a-4e94-bcd2-6f133874002d tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:19.597641 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-14207313-e09a-4e94-bcd2-6f133874002d tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:19.598380 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-14207313-e09a-4e94-bcd2-6f133874002d tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:19.599685 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-14207313-e09a-4e94-bcd2-6f133874002d tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:19.600528 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-14207313-e09a-4e94-bcd2-6f133874002d tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:19.601330 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-14207313-e09a-4e94-bcd2-6f133874002d tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:19.661877 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-14207313-e09a-4e94-bcd2-6f133874002d tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.087335 Nov 02 14:49:19.662721 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 452/929] 10.222.0.30 () {58 vars in 1302 bytes} [Wed Nov 2 14:49:19 2022] GET /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3/os-volume_attachments => generated 371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:49:19.811741 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-5b4d862f-dcda-47f6-a61a-460577e4fb5e tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:49:19.812328 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-5b4d862f-dcda-47f6-a61a-460577e4fb5e tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:49:19.819673 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5b4d862f-dcda-47f6-a61a-460577e4fb5e tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:19.820216 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5b4d862f-dcda-47f6-a61a-460577e4fb5e tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:19.820763 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5b4d862f-dcda-47f6-a61a-460577e4fb5e tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:19.821581 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5b4d862f-dcda-47f6-a61a-460577e4fb5e tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:19.822087 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5b4d862f-dcda-47f6-a61a-460577e4fb5e tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:19.822548 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5b4d862f-dcda-47f6-a61a-460577e4fb5e tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:19.856491 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-5b4d862f-dcda-47f6-a61a-460577e4fb5e tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3/os-volume_attachments/0a22a82b-c841-4b4d-8d35-057a02395b43" status: 200 len: 194 microversion: 2.1 time: 0.049471 Nov 02 14:49:19.857869 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 478/930] 10.222.0.30 () {58 vars in 1413 bytes} [Wed Nov 2 14:49:19 2022] GET /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3/os-volume_attachments/0a22a82b-c841-4b4d-8d35-057a02395b43 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:49:19.868891 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-bca32db0-0bee-464d-a35d-7587f3364503 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:49:19.869460 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-bca32db0-0bee-464d-a35d-7587f3364503 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:49:19.876208 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-bca32db0-0bee-464d-a35d-7587f3364503 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:19.876717 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-bca32db0-0bee-464d-a35d-7587f3364503 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:19.877186 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-bca32db0-0bee-464d-a35d-7587f3364503 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:19.877913 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-bca32db0-0bee-464d-a35d-7587f3364503 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:19.878398 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-bca32db0-0bee-464d-a35d-7587f3364503 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:19.878831 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-bca32db0-0bee-464d-a35d-7587f3364503 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:19.986655 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.objects.instance [None req-bca32db0-0bee-464d-a35d-7587f3364503 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lazy-loading 'services' on Instance uuid 34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3 {{(pid=119658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:49:20.197045 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-bca32db0-0bee-464d-a35d-7587f3364503 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "DELETE /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3/os-volume_attachments/0a22a82b-c841-4b4d-8d35-057a02395b43" status: 202 len: 0 microversion: 2.1 time: 0.332762 Nov 02 14:49:20.200748 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 453/931] 10.222.0.30 () {58 vars in 1416 bytes} [Wed Nov 2 14:49:19 2022] DELETE /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3/os-volume_attachments/0a22a82b-c841-4b4d-8d35-057a02395b43 => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:49:22.388741 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-98ffeba4-b7bd-4a00-9422-8da6a63fe82f tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:49:22.389596 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-98ffeba4-b7bd-4a00-9422-8da6a63fe82f tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:49:22.396270 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-98ffeba4-b7bd-4a00-9422-8da6a63fe82f tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:22.396760 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-98ffeba4-b7bd-4a00-9422-8da6a63fe82f tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:22.397245 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-98ffeba4-b7bd-4a00-9422-8da6a63fe82f tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:22.397988 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-98ffeba4-b7bd-4a00-9422-8da6a63fe82f tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:22.398444 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-98ffeba4-b7bd-4a00-9422-8da6a63fe82f tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:22.398872 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-98ffeba4-b7bd-4a00-9422-8da6a63fe82f tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:22.430897 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-98ffeba4-b7bd-4a00-9422-8da6a63fe82f tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3/os-volume_attachments/82f24355-1412-484a-a36a-aa4a95eea2d2" status: 200 len: 194 microversion: 2.1 time: 0.046869 Nov 02 14:49:22.431509 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 479/932] 10.222.0.30 () {58 vars in 1413 bytes} [Wed Nov 2 14:49:22 2022] GET /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3/os-volume_attachments/82f24355-1412-484a-a36a-aa4a95eea2d2 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:49:22.448642 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-c76f7edd-36be-4f01-9139-21e274ea343d tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:49:22.449703 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-c76f7edd-36be-4f01-9139-21e274ea343d tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:49:22.461887 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c76f7edd-36be-4f01-9139-21e274ea343d tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:22.462769 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c76f7edd-36be-4f01-9139-21e274ea343d tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:22.463569 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c76f7edd-36be-4f01-9139-21e274ea343d tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:22.464836 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c76f7edd-36be-4f01-9139-21e274ea343d tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:22.465712 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c76f7edd-36be-4f01-9139-21e274ea343d tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:22.466993 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c76f7edd-36be-4f01-9139-21e274ea343d tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:22.562407 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.objects.instance [None req-c76f7edd-36be-4f01-9139-21e274ea343d tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lazy-loading 'services' on Instance uuid 34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3 {{(pid=119658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:49:22.810907 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-c76f7edd-36be-4f01-9139-21e274ea343d tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "DELETE /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3/os-volume_attachments/82f24355-1412-484a-a36a-aa4a95eea2d2" status: 202 len: 0 microversion: 2.1 time: 0.370620 Nov 02 14:49:22.811500 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 454/933] 10.222.0.30 () {58 vars in 1416 bytes} [Wed Nov 2 14:49:22 2022] DELETE /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3/os-volume_attachments/82f24355-1412-484a-a36a-aa4a95eea2d2 => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:49:24.057717 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-d5a55c7f-452a-4643-a405-6ae986b74458 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:49:24.063419 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-d5a55c7f-452a-4643-a405-6ae986b74458 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:49:24.075039 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d5a55c7f-452a-4643-a405-6ae986b74458 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:24.076885 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d5a55c7f-452a-4643-a405-6ae986b74458 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:24.077738 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d5a55c7f-452a-4643-a405-6ae986b74458 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:24.078989 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d5a55c7f-452a-4643-a405-6ae986b74458 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:24.079798 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d5a55c7f-452a-4643-a405-6ae986b74458 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:24.080565 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d5a55c7f-452a-4643-a405-6ae986b74458 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:24.128468 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-d5a55c7f-452a-4643-a405-6ae986b74458 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.078146 Nov 02 14:49:24.129400 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 480/934] 10.222.0.30 () {58 vars in 1302 bytes} [Wed Nov 2 14:49:24 2022] GET /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3/os-volume_attachments => generated 25 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 14:49:24.260073 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-2166f8af-c745-41a6-9d7d-d76ed629eb5c tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:49:24.262363 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-2166f8af-c745-41a6-9d7d-d76ed629eb5c tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:49:24.270281 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2166f8af-c745-41a6-9d7d-d76ed629eb5c tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:24.270780 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2166f8af-c745-41a6-9d7d-d76ed629eb5c tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:24.271224 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2166f8af-c745-41a6-9d7d-d76ed629eb5c tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:24.271942 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2166f8af-c745-41a6-9d7d-d76ed629eb5c tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:24.272402 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2166f8af-c745-41a6-9d7d-d76ed629eb5c tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:24.272837 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2166f8af-c745-41a6-9d7d-d76ed629eb5c tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:24.304294 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-2166f8af-c745-41a6-9d7d-d76ed629eb5c tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048962 Nov 02 14:49:24.304961 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 455/935] 10.222.0.30 () {58 vars in 1302 bytes} [Wed Nov 2 14:49:24 2022] GET /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 14:49:24.374968 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-9aad2fa9-4540-4a41-ba68-f6044c7b5415 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:49:24.375472 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-9aad2fa9-4540-4a41-ba68-f6044c7b5415 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:49:24.382115 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9aad2fa9-4540-4a41-ba68-f6044c7b5415 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:24.382527 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9aad2fa9-4540-4a41-ba68-f6044c7b5415 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:24.382973 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9aad2fa9-4540-4a41-ba68-f6044c7b5415 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:24.383700 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9aad2fa9-4540-4a41-ba68-f6044c7b5415 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:24.384164 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9aad2fa9-4540-4a41-ba68-f6044c7b5415 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:24.384605 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9aad2fa9-4540-4a41-ba68-f6044c7b5415 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:24.413870 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-9aad2fa9-4540-4a41-ba68-f6044c7b5415 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3] Going to try to terminate instance {{(pid=119659) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:49:24.754957 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-9aad2fa9-4540-4a41-ba68-f6044c7b5415 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "DELETE /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3" status: 204 len: 0 microversion: 2.1 time: 0.384170 Nov 02 14:49:24.755701 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 481/936] 10.222.0.30 () {58 vars in 1239 bytes} [Wed Nov 2 14:49:24 2022] DELETE /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 14:49:24.765433 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-0d9d8912-b7e2-4a8a-a5be-90bc908a8831 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:49:24.766060 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-0d9d8912-b7e2-4a8a-a5be-90bc908a8831 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:49:24.772518 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0d9d8912-b7e2-4a8a-a5be-90bc908a8831 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:24.773038 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0d9d8912-b7e2-4a8a-a5be-90bc908a8831 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:24.773494 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0d9d8912-b7e2-4a8a-a5be-90bc908a8831 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:24.774208 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0d9d8912-b7e2-4a8a-a5be-90bc908a8831 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:24.774669 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0d9d8912-b7e2-4a8a-a5be-90bc908a8831 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:24.775097 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0d9d8912-b7e2-4a8a-a5be-90bc908a8831 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:25.018661 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-0d9d8912-b7e2-4a8a-a5be-90bc908a8831 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:49:25.027031 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-0d9d8912-b7e2-4a8a-a5be-90bc908a8831 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3" status: 200 len: 1672 microversion: 2.1 time: 0.266448 Nov 02 14:49:25.027775 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 456/937] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:49:24 2022] GET /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3 => generated 1672 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:49:26.053109 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-0d232a19-759d-4fd6-bf93-7c83a2507218 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:49:26.053862 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-0d232a19-759d-4fd6-bf93-7c83a2507218 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:49:26.061412 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0d232a19-759d-4fd6-bf93-7c83a2507218 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:26.061912 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0d232a19-759d-4fd6-bf93-7c83a2507218 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:26.062357 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0d232a19-759d-4fd6-bf93-7c83a2507218 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:26.063101 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0d232a19-759d-4fd6-bf93-7c83a2507218 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:26.063565 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0d232a19-759d-4fd6-bf93-7c83a2507218 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:26.064000 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0d232a19-759d-4fd6-bf93-7c83a2507218 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:26.286946 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-0d232a19-759d-4fd6-bf93-7c83a2507218 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:49:26.296850 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-0d232a19-759d-4fd6-bf93-7c83a2507218 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3" status: 200 len: 1672 microversion: 2.1 time: 0.248020 Nov 02 14:49:26.297496 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 482/938] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:49:26 2022] GET /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3 => generated 1672 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:49:27.336862 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-415613f5-11e3-4eaf-8346-b062fc43e77d tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:49:27.337822 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-415613f5-11e3-4eaf-8346-b062fc43e77d tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:49:27.346193 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-415613f5-11e3-4eaf-8346-b062fc43e77d tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:27.346866 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-415613f5-11e3-4eaf-8346-b062fc43e77d tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:27.347527 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-415613f5-11e3-4eaf-8346-b062fc43e77d tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:27.348412 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-415613f5-11e3-4eaf-8346-b062fc43e77d tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:27.349167 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-415613f5-11e3-4eaf-8346-b062fc43e77d tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:27.349642 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-415613f5-11e3-4eaf-8346-b062fc43e77d tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:27.545456 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-415613f5-11e3-4eaf-8346-b062fc43e77d tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:49:27.553457 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-415613f5-11e3-4eaf-8346-b062fc43e77d tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3" status: 200 len: 1672 microversion: 2.1 time: 0.220522 Nov 02 14:49:27.554040 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 457/939] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:49:27 2022] GET /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3 => generated 1672 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:49:28.221906 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [req-97ce8c0f-b0c7-4ae5-9b35-bcb0f3cecf91 req-81af68df-5214-4cfc-a19e-0d007f36053e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3", "name": "network-vif-deleted", "tag": "d1638fe4-d11f-4f39-8b81-4f5434920e98"}]} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:49:28.232067 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-97ce8c0f-b0c7-4ae5-9b35-bcb0f3cecf91 req-81af68df-5214-4cfc-a19e-0d007f36053e service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:28.232647 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-97ce8c0f-b0c7-4ae5-9b35-bcb0f3cecf91 req-81af68df-5214-4cfc-a19e-0d007f36053e service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:28.236299 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-97ce8c0f-b0c7-4ae5-9b35-bcb0f3cecf91 req-81af68df-5214-4cfc-a19e-0d007f36053e service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:28.245738 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.compute.server_external_events [req-97ce8c0f-b0c7-4ae5-9b35-bcb0f3cecf91 req-81af68df-5214-4cfc-a19e-0d007f36053e service nova] Creating event network-vif-deleted:d1638fe4-d11f-4f39-8b81-4f5434920e98 for instance 34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3 on hv-cinder-86236 Nov 02 14:49:28.251910 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [req-97ce8c0f-b0c7-4ae5-9b35-bcb0f3cecf91 req-81af68df-5214-4cfc-a19e-0d007f36053e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033634 Nov 02 14:49:28.252830 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 483/940] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:49:28.593042 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-ad15cb46-4837-4ab0-baeb-7ee82eacda63 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:49:28.594267 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-ad15cb46-4837-4ab0-baeb-7ee82eacda63 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:49:28.602202 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ad15cb46-4837-4ab0-baeb-7ee82eacda63 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:28.602904 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ad15cb46-4837-4ab0-baeb-7ee82eacda63 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:28.603633 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ad15cb46-4837-4ab0-baeb-7ee82eacda63 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:28.604506 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ad15cb46-4837-4ab0-baeb-7ee82eacda63 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:28.605171 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ad15cb46-4837-4ab0-baeb-7ee82eacda63 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:28.605742 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ad15cb46-4837-4ab0-baeb-7ee82eacda63 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:28.672038 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ad15cb46-4837-4ab0-baeb-7ee82eacda63 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:28.672841 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ad15cb46-4837-4ab0-baeb-7ee82eacda63 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:28.673699 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ad15cb46-4837-4ab0-baeb-7ee82eacda63 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:28.674518 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.objects.instance [None req-ad15cb46-4837-4ab0-baeb-7ee82eacda63 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lazy-loading 'fault' on Instance uuid 34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3 {{(pid=119658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:49:28.745198 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-ad15cb46-4837-4ab0-baeb-7ee82eacda63 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6069bdb19c5c42ff8546aef3197a6a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf7381b1bf545c39936c96595aa36f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:49:28.760941 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-ad15cb46-4837-4ab0-baeb-7ee82eacda63 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3" status: 200 len: 1326 microversion: 2.1 time: 0.172652 Nov 02 14:49:28.774004 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 458/941] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:49:28 2022] GET /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3 => generated 1326 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:49:29.810524 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-d6e60adf-62ec-4ad4-bec7-fec5506bb34b tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:49:29.811801 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-d6e60adf-62ec-4ad4-bec7-fec5506bb34b tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:49:29.823486 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d6e60adf-62ec-4ad4-bec7-fec5506bb34b tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:29.824365 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d6e60adf-62ec-4ad4-bec7-fec5506bb34b tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:29.825841 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d6e60adf-62ec-4ad4-bec7-fec5506bb34b tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:29.827050 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d6e60adf-62ec-4ad4-bec7-fec5506bb34b tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:29.827864 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d6e60adf-62ec-4ad4-bec7-fec5506bb34b tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:29.828684 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d6e60adf-62ec-4ad4-bec7-fec5506bb34b tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:29.854973 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.wsgi [None req-d6e60adf-62ec-4ad4-bec7-fec5506bb34b tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] HTTP exception thrown: Instance 34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3 could not be found. Nov 02 14:49:29.858381 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-d6e60adf-62ec-4ad4-bec7-fec5506bb34b tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Request method failure captured: Nov 02 14:49:29.858381 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: request: GET /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3 HTTP/1.1 Nov 02 14:49:29.858381 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Accept: application/json Nov 02 14:49:29.858381 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Accept-Encoding: identity Nov 02 14:49:29.858381 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Connection: close Nov 02 14:49:29.858381 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Content-Length: 0 Nov 02 14:49:29.858381 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Content-Type: application/json Nov 02 14:49:29.858381 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Host: 10.222.0.30 Nov 02 14:49:29.858381 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Openstack-System-Scope: None Nov 02 14:49:29.858381 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: User-Agent: python-urllib3/1.26.12 Nov 02 14:49:29.858381 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Auth-Token: gAAAAABjYoJpouzTtMAiiS2m-qbZYsM19K1NYzXoh_Ug2s1Oyy1UWotkESdRxWL31k2eSzlbFi0CSuxtkkgrcjIxQAj2oKg5rSgNfrDQCBT6qSsuHlNry_j922Z87azrIo4qbg3XvOK8bRdYI4jTLV9QyDJKXYEKvzAifuFkgpEaqo4RVpKRhaM Nov 02 14:49:29.858381 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Domain-Id: None Nov 02 14:49:29.858381 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Domain-Name: None Nov 02 14:49:29.858381 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Identity-Status: Confirmed Nov 02 14:49:29.858381 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Is-Admin-Project: True Nov 02 14:49:29.858381 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Domain-Id: default Nov 02 14:49:29.858381 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Domain-Name: Default Nov 02 14:49:29.858381 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Id: 2bf7381b1bf545c39936c96595aa36f4 Nov 02 14:49:29.858381 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Name: tempest-AttachVolumeTestJSON-833749050 Nov 02 14:49:29.858381 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Role: reader,member Nov 02 14:49:29.858381 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Roles: reader,member Nov 02 14:49:29.860935 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2bf7381b1bf545c39936c96595aa36f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2bf7381b1bf545c39936c96595aa36f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2bf7381b1bf545c39936c96595aa36f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2bf7381b1bf545c39936c96595aa36f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:49:29.860935 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant: tempest-AttachVolumeTestJSON-833749050 Nov 02 14:49:29.860935 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant-Id: 2bf7381b1bf545c39936c96595aa36f4 Nov 02 14:49:29.860935 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant-Name: tempest-AttachVolumeTestJSON-833749050 Nov 02 14:49:29.860935 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User: tempest-AttachVolumeTestJSON-833749050-project Nov 02 14:49:29.860935 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Domain-Id: default Nov 02 14:49:29.860935 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Domain-Name: Default Nov 02 14:49:29.860935 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Id: 6069bdb19c5c42ff8546aef3197a6a2b Nov 02 14:49:29.860935 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Name: tempest-AttachVolumeTestJSON-833749050-project Nov 02 14:49:29.860935 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: method: > Nov 02 14:49:29.860935 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: exception: Instance 34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3 could not be found. Nov 02 14:49:29.860935 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: action_args: {'id': '34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3'} Nov 02 14:49:29.862441 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:49:29.862441 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:49:29.862441 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:49:29.862441 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:49:29.862441 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:49:29.862441 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:49:29.862441 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:49:29.862441 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:49:29.862441 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:49:29.862441 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:49:29.862441 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3 could not be found. Nov 02 14:49:29.862441 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:49:29.862441 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:49:29.862441 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:49:29.862441 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:49:29.862441 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:49:29.862441 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:49:29.862441 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:49:29.862441 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:49:29.862441 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:49:29.865270 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:49:29.865270 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:49:29.865270 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:49:29.865270 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:49:29.865270 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:49:29.865270 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:49:29.865270 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:49:29.865270 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3 could not be found. Nov 02 14:49:29.865270 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:49:29.865270 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:49:29.865270 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:49:29.865270 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:49:29.865270 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:49:29.865270 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:49:29.865270 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:49:29.865270 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:49:29.865270 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3 could not be found. Nov 02 14:49:29.865270 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:49:29.867649 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-d6e60adf-62ec-4ad4-bec7-fec5506bb34b tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Returning 404 to user: Instance 34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3 could not be found. {{(pid=119659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:49:29.867649 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-d6e60adf-62ec-4ad4-bec7-fec5506bb34b tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3" status: 404 len: 111 microversion: 2.1 time: 0.059426 Nov 02 14:49:29.867649 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 484/942] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:49:29 2022] GET /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:49:29.874593 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-01f3d29e-5b60-4aa8-83f8-08ac46a7ef41 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '.version_select at 0x7fb24edce940>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:49:30.013164 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-01f3d29e-5b60-4aa8-83f8-08ac46a7ef41 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-195435391" status: 202 len: 0 microversion: 2.1 time: 0.143313 Nov 02 14:49:30.013786 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 459/943] 10.222.0.30 () {58 vars in 1218 bytes} [Wed Nov 2 14:49:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-195435391 => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:49:33.472509 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-650b7e06-33c9-4e05-8f3e-94421c32c181 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:49:33.473178 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-650b7e06-33c9-4e05-8f3e-94421c32c181 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:49:33.480440 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-650b7e06-33c9-4e05-8f3e-94421c32c181 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:33.480928 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-650b7e06-33c9-4e05-8f3e-94421c32c181 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:33.482706 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-650b7e06-33c9-4e05-8f3e-94421c32c181 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:33.483495 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-650b7e06-33c9-4e05-8f3e-94421c32c181 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:33.483981 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-650b7e06-33c9-4e05-8f3e-94421c32c181 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:33.484414 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-650b7e06-33c9-4e05-8f3e-94421c32c181 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:33.500277 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.wsgi [None req-650b7e06-33c9-4e05-8f3e-94421c32c181 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] HTTP exception thrown: Instance 34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3 could not be found. Nov 02 14:49:33.501923 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-650b7e06-33c9-4e05-8f3e-94421c32c181 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Request method failure captured: Nov 02 14:49:33.501923 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: request: DELETE /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3 HTTP/1.1 Nov 02 14:49:33.501923 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Accept: application/json Nov 02 14:49:33.501923 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Accept-Encoding: identity Nov 02 14:49:33.501923 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Connection: close Nov 02 14:49:33.501923 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Content-Length: 0 Nov 02 14:49:33.501923 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Content-Type: application/json Nov 02 14:49:33.501923 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Host: 10.222.0.30 Nov 02 14:49:33.501923 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Openstack-System-Scope: None Nov 02 14:49:33.501923 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: User-Agent: python-urllib3/1.26.12 Nov 02 14:49:33.501923 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Auth-Token: gAAAAABjYoJpouzTtMAiiS2m-qbZYsM19K1NYzXoh_Ug2s1Oyy1UWotkESdRxWL31k2eSzlbFi0CSuxtkkgrcjIxQAj2oKg5rSgNfrDQCBT6qSsuHlNry_j922Z87azrIo4qbg3XvOK8bRdYI4jTLV9QyDJKXYEKvzAifuFkgpEaqo4RVpKRhaM Nov 02 14:49:33.501923 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Domain-Id: None Nov 02 14:49:33.501923 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Domain-Name: None Nov 02 14:49:33.501923 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Identity-Status: Confirmed Nov 02 14:49:33.501923 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Is-Admin-Project: True Nov 02 14:49:33.501923 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Domain-Id: default Nov 02 14:49:33.501923 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Domain-Name: Default Nov 02 14:49:33.501923 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Id: 2bf7381b1bf545c39936c96595aa36f4 Nov 02 14:49:33.501923 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Name: tempest-AttachVolumeTestJSON-833749050 Nov 02 14:49:33.501923 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Role: reader,member Nov 02 14:49:33.501923 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Roles: reader,member Nov 02 14:49:33.504819 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2bf7381b1bf545c39936c96595aa36f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2bf7381b1bf545c39936c96595aa36f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2bf7381b1bf545c39936c96595aa36f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2bf7381b1bf545c39936c96595aa36f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:49:33.504819 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant: tempest-AttachVolumeTestJSON-833749050 Nov 02 14:49:33.504819 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant-Id: 2bf7381b1bf545c39936c96595aa36f4 Nov 02 14:49:33.504819 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant-Name: tempest-AttachVolumeTestJSON-833749050 Nov 02 14:49:33.504819 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User: tempest-AttachVolumeTestJSON-833749050-project Nov 02 14:49:33.504819 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Domain-Id: default Nov 02 14:49:33.504819 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Domain-Name: Default Nov 02 14:49:33.504819 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Id: 6069bdb19c5c42ff8546aef3197a6a2b Nov 02 14:49:33.504819 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Name: tempest-AttachVolumeTestJSON-833749050-project Nov 02 14:49:33.504819 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: method: > Nov 02 14:49:33.504819 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: exception: Instance 34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3 could not be found. Nov 02 14:49:33.504819 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: action_args: {'id': '34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3'} Nov 02 14:49:33.506205 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:49:33.506205 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:49:33.506205 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:49:33.506205 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:49:33.506205 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:49:33.506205 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:49:33.506205 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:49:33.506205 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:49:33.506205 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:49:33.506205 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:49:33.506205 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3 could not be found. Nov 02 14:49:33.506205 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:49:33.506205 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:49:33.506205 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:49:33.506205 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:49:33.506205 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:49:33.506205 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:49:33.506205 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:49:33.506205 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:49:33.506205 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:49:33.508788 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:49:33.508788 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:49:33.508788 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:49:33.508788 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:49:33.508788 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:49:33.508788 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:49:33.508788 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:49:33.508788 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:49:33.508788 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:49:33.508788 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3 could not be found. Nov 02 14:49:33.508788 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:49:33.508788 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:49:33.508788 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:49:33.508788 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:49:33.508788 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:49:33.508788 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:49:33.508788 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:49:33.508788 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:49:33.508788 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3 could not be found. Nov 02 14:49:33.508788 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:49:33.511387 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-650b7e06-33c9-4e05-8f3e-94421c32c181 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Returning 404 to user: Instance 34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3 could not be found. {{(pid=119659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:49:33.511387 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-650b7e06-33c9-4e05-8f3e-94421c32c181 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "DELETE /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3" status: 404 len: 111 microversion: 2.1 time: 0.034915 Nov 02 14:49:33.511387 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 485/944] 10.222.0.30 () {58 vars in 1239 bytes} [Wed Nov 2 14:49:33 2022] DELETE /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:49:33.514281 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-52249008-3089-437d-8785-9e22f6317dc4 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:49:33.515102 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-52249008-3089-437d-8785-9e22f6317dc4 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:49:33.521762 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-52249008-3089-437d-8785-9e22f6317dc4 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:33.522251 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-52249008-3089-437d-8785-9e22f6317dc4 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:33.522690 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-52249008-3089-437d-8785-9e22f6317dc4 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:33.523391 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-52249008-3089-437d-8785-9e22f6317dc4 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:33.523838 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-52249008-3089-437d-8785-9e22f6317dc4 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:33.524257 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-52249008-3089-437d-8785-9e22f6317dc4 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:33.527250 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=2 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:49:33.540616 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.wsgi [None req-52249008-3089-437d-8785-9e22f6317dc4 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] HTTP exception thrown: Instance 34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3 could not be found. Nov 02 14:49:33.544694 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-52249008-3089-437d-8785-9e22f6317dc4 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Request method failure captured: Nov 02 14:49:33.544694 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: request: GET /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3 HTTP/1.1 Nov 02 14:49:33.544694 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Accept: application/json Nov 02 14:49:33.544694 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Accept-Encoding: identity Nov 02 14:49:33.544694 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Connection: close Nov 02 14:49:33.544694 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Content-Length: 0 Nov 02 14:49:33.544694 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Content-Type: application/json Nov 02 14:49:33.544694 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Host: 10.222.0.30 Nov 02 14:49:33.544694 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Openstack-System-Scope: None Nov 02 14:49:33.544694 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: User-Agent: python-urllib3/1.26.12 Nov 02 14:49:33.544694 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Auth-Token: gAAAAABjYoJpouzTtMAiiS2m-qbZYsM19K1NYzXoh_Ug2s1Oyy1UWotkESdRxWL31k2eSzlbFi0CSuxtkkgrcjIxQAj2oKg5rSgNfrDQCBT6qSsuHlNry_j922Z87azrIo4qbg3XvOK8bRdYI4jTLV9QyDJKXYEKvzAifuFkgpEaqo4RVpKRhaM Nov 02 14:49:33.544694 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Domain-Id: None Nov 02 14:49:33.544694 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Domain-Name: None Nov 02 14:49:33.544694 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Identity-Status: Confirmed Nov 02 14:49:33.544694 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Is-Admin-Project: True Nov 02 14:49:33.544694 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Domain-Id: default Nov 02 14:49:33.544694 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Domain-Name: Default Nov 02 14:49:33.544694 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Id: 2bf7381b1bf545c39936c96595aa36f4 Nov 02 14:49:33.544694 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Name: tempest-AttachVolumeTestJSON-833749050 Nov 02 14:49:33.544694 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Role: reader,member Nov 02 14:49:33.544694 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Roles: reader,member Nov 02 14:49:33.547799 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2bf7381b1bf545c39936c96595aa36f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2bf7381b1bf545c39936c96595aa36f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2bf7381b1bf545c39936c96595aa36f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2bf7381b1bf545c39936c96595aa36f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:49:33.547799 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant: tempest-AttachVolumeTestJSON-833749050 Nov 02 14:49:33.547799 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant-Id: 2bf7381b1bf545c39936c96595aa36f4 Nov 02 14:49:33.547799 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant-Name: tempest-AttachVolumeTestJSON-833749050 Nov 02 14:49:33.547799 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User: tempest-AttachVolumeTestJSON-833749050-project Nov 02 14:49:33.547799 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Domain-Id: default Nov 02 14:49:33.547799 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Domain-Name: Default Nov 02 14:49:33.547799 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Id: 6069bdb19c5c42ff8546aef3197a6a2b Nov 02 14:49:33.547799 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Name: tempest-AttachVolumeTestJSON-833749050-project Nov 02 14:49:33.547799 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: method: > Nov 02 14:49:33.547799 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: exception: Instance 34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3 could not be found. Nov 02 14:49:33.547799 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: action_args: {'id': '34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3'} Nov 02 14:49:33.549380 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:49:33.549380 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:49:33.549380 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:49:33.549380 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:49:33.549380 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:49:33.549380 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:49:33.549380 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:49:33.549380 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:49:33.549380 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:49:33.549380 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:49:33.549380 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3 could not be found. Nov 02 14:49:33.549380 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:49:33.549380 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:49:33.549380 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:49:33.549380 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:49:33.549380 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:49:33.549380 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:49:33.549380 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:49:33.549380 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:49:33.549380 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:49:33.551899 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:49:33.551899 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:49:33.551899 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:49:33.551899 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:49:33.551899 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:49:33.551899 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:49:33.551899 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:49:33.551899 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3 could not be found. Nov 02 14:49:33.551899 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:49:33.551899 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:49:33.551899 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:49:33.551899 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:49:33.551899 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:49:33.551899 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:49:33.551899 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:49:33.551899 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:49:33.551899 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3 could not be found. Nov 02 14:49:33.551899 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:49:33.554852 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-52249008-3089-437d-8785-9e22f6317dc4 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Returning 404 to user: Instance 34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3 could not be found. {{(pid=119658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:49:33.554852 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-52249008-3089-437d-8785-9e22f6317dc4 tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3" status: 404 len: 111 microversion: 2.1 time: 0.035097 Nov 02 14:49:33.554852 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 460/945] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:49:33 2022] GET /compute/v2.1/servers/34683ea9-c4a1-43d4-ab19-4c2fc5b2ebb3 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 14:49:34.874995 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-c5343f12-945b-4657-b8c6-0c911a88148f tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:49:34.875875 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-c5343f12-945b-4657-b8c6-0c911a88148f tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:49:34.890318 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c5343f12-945b-4657-b8c6-0c911a88148f tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:34.890318 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c5343f12-945b-4657-b8c6-0c911a88148f tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:34.890318 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c5343f12-945b-4657-b8c6-0c911a88148f tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:34.890318 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c5343f12-945b-4657-b8c6-0c911a88148f tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:34.891199 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c5343f12-945b-4657-b8c6-0c911a88148f tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:34.891961 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c5343f12-945b-4657-b8c6-0c911a88148f tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:34.916711 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.wsgi [None req-c5343f12-945b-4657-b8c6-0c911a88148f tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] HTTP exception thrown: Instance 9dff2e06-ddf6-4c7a-8887-40092f0f9290 could not be found. Nov 02 14:49:34.919377 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-c5343f12-945b-4657-b8c6-0c911a88148f tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Request method failure captured: Nov 02 14:49:34.919377 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: request: DELETE /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290 HTTP/1.1 Nov 02 14:49:34.919377 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Accept: application/json Nov 02 14:49:34.919377 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Accept-Encoding: identity Nov 02 14:49:34.919377 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Connection: close Nov 02 14:49:34.919377 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Content-Length: 0 Nov 02 14:49:34.919377 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Content-Type: application/json Nov 02 14:49:34.919377 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Host: 10.222.0.30 Nov 02 14:49:34.919377 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Openstack-System-Scope: None Nov 02 14:49:34.919377 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: User-Agent: python-urllib3/1.26.12 Nov 02 14:49:34.919377 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Auth-Token: gAAAAABjYoJpouzTtMAiiS2m-qbZYsM19K1NYzXoh_Ug2s1Oyy1UWotkESdRxWL31k2eSzlbFi0CSuxtkkgrcjIxQAj2oKg5rSgNfrDQCBT6qSsuHlNry_j922Z87azrIo4qbg3XvOK8bRdYI4jTLV9QyDJKXYEKvzAifuFkgpEaqo4RVpKRhaM Nov 02 14:49:34.919377 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Domain-Id: None Nov 02 14:49:34.919377 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Domain-Name: None Nov 02 14:49:34.919377 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Identity-Status: Confirmed Nov 02 14:49:34.919377 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Is-Admin-Project: True Nov 02 14:49:34.919377 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Domain-Id: default Nov 02 14:49:34.919377 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Domain-Name: Default Nov 02 14:49:34.919377 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Id: 2bf7381b1bf545c39936c96595aa36f4 Nov 02 14:49:34.919377 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Name: tempest-AttachVolumeTestJSON-833749050 Nov 02 14:49:34.919377 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Role: reader,member Nov 02 14:49:34.919377 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Roles: reader,member Nov 02 14:49:34.926523 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2bf7381b1bf545c39936c96595aa36f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2bf7381b1bf545c39936c96595aa36f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2bf7381b1bf545c39936c96595aa36f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2bf7381b1bf545c39936c96595aa36f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:49:34.926523 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant: tempest-AttachVolumeTestJSON-833749050 Nov 02 14:49:34.926523 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant-Id: 2bf7381b1bf545c39936c96595aa36f4 Nov 02 14:49:34.926523 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant-Name: tempest-AttachVolumeTestJSON-833749050 Nov 02 14:49:34.926523 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User: tempest-AttachVolumeTestJSON-833749050-project Nov 02 14:49:34.926523 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Domain-Id: default Nov 02 14:49:34.926523 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Domain-Name: Default Nov 02 14:49:34.926523 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Id: 6069bdb19c5c42ff8546aef3197a6a2b Nov 02 14:49:34.926523 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Name: tempest-AttachVolumeTestJSON-833749050-project Nov 02 14:49:34.926523 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: method: > Nov 02 14:49:34.926523 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: exception: Instance 9dff2e06-ddf6-4c7a-8887-40092f0f9290 could not be found. Nov 02 14:49:34.926523 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: action_args: {'id': '9dff2e06-ddf6-4c7a-8887-40092f0f9290'} Nov 02 14:49:34.927846 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:49:34.927846 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:49:34.927846 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:49:34.927846 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:49:34.927846 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:49:34.927846 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:49:34.927846 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:49:34.927846 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:49:34.927846 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:49:34.927846 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:49:34.927846 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dff2e06-ddf6-4c7a-8887-40092f0f9290 could not be found. Nov 02 14:49:34.927846 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:49:34.927846 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:49:34.927846 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:49:34.927846 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:49:34.927846 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:49:34.927846 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:49:34.927846 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:49:34.927846 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:49:34.927846 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:49:34.930164 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:49:34.930164 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:49:34.930164 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:49:34.930164 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:49:34.930164 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:49:34.930164 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:49:34.930164 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:49:34.930164 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:49:34.930164 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:49:34.930164 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dff2e06-ddf6-4c7a-8887-40092f0f9290 could not be found. Nov 02 14:49:34.930164 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:49:34.930164 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:49:34.930164 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:49:34.930164 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:49:34.930164 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:49:34.930164 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:49:34.930164 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:49:34.930164 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:49:34.930164 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dff2e06-ddf6-4c7a-8887-40092f0f9290 could not be found. Nov 02 14:49:34.930164 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:49:34.932407 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-c5343f12-945b-4657-b8c6-0c911a88148f tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Returning 404 to user: Instance 9dff2e06-ddf6-4c7a-8887-40092f0f9290 could not be found. {{(pid=119659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:49:34.932407 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-c5343f12-945b-4657-b8c6-0c911a88148f tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290" status: 404 len: 111 microversion: 2.1 time: 0.054806 Nov 02 14:49:34.932407 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 486/946] 10.222.0.30 () {58 vars in 1239 bytes} [Wed Nov 2 14:49:34 2022] DELETE /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:49:34.932819 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-e4f0beb0-5c31-4554-9b94-cdabcaf1f2bb tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:49:34.932819 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-e4f0beb0-5c31-4554-9b94-cdabcaf1f2bb tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] [instance: 9dff2e06-ddf6-4c7a-8887-40092f0f9290] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:49:34.939792 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e4f0beb0-5c31-4554-9b94-cdabcaf1f2bb tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:34.940282 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e4f0beb0-5c31-4554-9b94-cdabcaf1f2bb tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:34.940721 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e4f0beb0-5c31-4554-9b94-cdabcaf1f2bb tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:34.941477 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e4f0beb0-5c31-4554-9b94-cdabcaf1f2bb tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:34.941930 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e4f0beb0-5c31-4554-9b94-cdabcaf1f2bb tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:34.942503 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e4f0beb0-5c31-4554-9b94-cdabcaf1f2bb tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:34.959789 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.wsgi [None req-e4f0beb0-5c31-4554-9b94-cdabcaf1f2bb tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] HTTP exception thrown: Instance 9dff2e06-ddf6-4c7a-8887-40092f0f9290 could not be found. Nov 02 14:49:34.961402 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-e4f0beb0-5c31-4554-9b94-cdabcaf1f2bb tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Request method failure captured: Nov 02 14:49:34.961402 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: request: GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290 HTTP/1.1 Nov 02 14:49:34.961402 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Accept: application/json Nov 02 14:49:34.961402 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Accept-Encoding: identity Nov 02 14:49:34.961402 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Connection: close Nov 02 14:49:34.961402 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Content-Length: 0 Nov 02 14:49:34.961402 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Content-Type: application/json Nov 02 14:49:34.961402 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Host: 10.222.0.30 Nov 02 14:49:34.961402 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Openstack-System-Scope: None Nov 02 14:49:34.961402 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: User-Agent: python-urllib3/1.26.12 Nov 02 14:49:34.961402 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Auth-Token: gAAAAABjYoJpouzTtMAiiS2m-qbZYsM19K1NYzXoh_Ug2s1Oyy1UWotkESdRxWL31k2eSzlbFi0CSuxtkkgrcjIxQAj2oKg5rSgNfrDQCBT6qSsuHlNry_j922Z87azrIo4qbg3XvOK8bRdYI4jTLV9QyDJKXYEKvzAifuFkgpEaqo4RVpKRhaM Nov 02 14:49:34.961402 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Domain-Id: None Nov 02 14:49:34.961402 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Domain-Name: None Nov 02 14:49:34.961402 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Identity-Status: Confirmed Nov 02 14:49:34.961402 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Is-Admin-Project: True Nov 02 14:49:34.961402 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Domain-Id: default Nov 02 14:49:34.961402 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Domain-Name: Default Nov 02 14:49:34.961402 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Id: 2bf7381b1bf545c39936c96595aa36f4 Nov 02 14:49:34.961402 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Name: tempest-AttachVolumeTestJSON-833749050 Nov 02 14:49:34.961402 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Role: reader,member Nov 02 14:49:34.961402 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Roles: reader,member Nov 02 14:49:34.963657 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2bf7381b1bf545c39936c96595aa36f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2bf7381b1bf545c39936c96595aa36f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2bf7381b1bf545c39936c96595aa36f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2bf7381b1bf545c39936c96595aa36f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:49:34.963657 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant: tempest-AttachVolumeTestJSON-833749050 Nov 02 14:49:34.963657 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant-Id: 2bf7381b1bf545c39936c96595aa36f4 Nov 02 14:49:34.963657 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant-Name: tempest-AttachVolumeTestJSON-833749050 Nov 02 14:49:34.963657 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User: tempest-AttachVolumeTestJSON-833749050-project Nov 02 14:49:34.963657 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Domain-Id: default Nov 02 14:49:34.963657 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Domain-Name: Default Nov 02 14:49:34.963657 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Id: 6069bdb19c5c42ff8546aef3197a6a2b Nov 02 14:49:34.963657 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Name: tempest-AttachVolumeTestJSON-833749050-project Nov 02 14:49:34.963657 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: method: > Nov 02 14:49:34.963657 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: exception: Instance 9dff2e06-ddf6-4c7a-8887-40092f0f9290 could not be found. Nov 02 14:49:34.963657 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: action_args: {'id': '9dff2e06-ddf6-4c7a-8887-40092f0f9290'} Nov 02 14:49:34.964843 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:49:34.964843 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:49:34.964843 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:49:34.964843 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:49:34.964843 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:49:34.964843 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:49:34.964843 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:49:34.964843 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:49:34.964843 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:49:34.964843 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:49:34.964843 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dff2e06-ddf6-4c7a-8887-40092f0f9290 could not be found. Nov 02 14:49:34.964843 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:49:34.964843 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:49:34.964843 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:49:34.964843 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:49:34.964843 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:49:34.964843 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:49:34.964843 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:49:34.964843 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:49:34.964843 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:49:34.967049 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:49:34.967049 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:49:34.967049 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:49:34.967049 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:49:34.967049 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:49:34.967049 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:49:34.967049 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:49:34.967049 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dff2e06-ddf6-4c7a-8887-40092f0f9290 could not be found. Nov 02 14:49:34.967049 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:49:34.967049 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:49:34.967049 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:49:34.967049 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:49:34.967049 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:49:34.967049 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:49:34.967049 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:49:34.967049 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:49:34.967049 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dff2e06-ddf6-4c7a-8887-40092f0f9290 could not be found. Nov 02 14:49:34.967049 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:49:34.968824 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-e4f0beb0-5c31-4554-9b94-cdabcaf1f2bb tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] Returning 404 to user: Instance 9dff2e06-ddf6-4c7a-8887-40092f0f9290 could not be found. {{(pid=119658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:49:34.968824 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-e4f0beb0-5c31-4554-9b94-cdabcaf1f2bb tempest-AttachVolumeTestJSON-833749050 tempest-AttachVolumeTestJSON-833749050-project] 10.222.0.30 "GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290" status: 404 len: 111 microversion: 2.1 time: 0.035483 Nov 02 14:49:34.968824 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 461/947] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:49:34 2022] GET /compute/v2.1/servers/9dff2e06-ddf6-4c7a-8887-40092f0f9290 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:49:47.016285 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-53cdbbf9-296e-4579-9e10-60175d3c29ab tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:49:47.018183 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-53cdbbf9-296e-4579-9e10-60175d3c29ab tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 7865fba9-1731-407f-a709-d60f1432e269] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:49:47.022945 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:49:47.024169 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:49:47.033825 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-53cdbbf9-296e-4579-9e10-60175d3c29ab tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:47.034718 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-53cdbbf9-296e-4579-9e10-60175d3c29ab tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:47.035491 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-53cdbbf9-296e-4579-9e10-60175d3c29ab tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:47.036778 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-53cdbbf9-296e-4579-9e10-60175d3c29ab tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:47.037738 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-53cdbbf9-296e-4579-9e10-60175d3c29ab tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:47.038597 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-53cdbbf9-296e-4579-9e10-60175d3c29ab tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:47.087537 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-53cdbbf9-296e-4579-9e10-60175d3c29ab tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/7865fba9-1731-407f-a709-d60f1432e269/ips" status: 200 len: 149 microversion: 2.1 time: 0.079760 Nov 02 14:49:47.088612 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 487/948] 10.222.0.30 () {58 vars in 1248 bytes} [Wed Nov 2 14:49:47 2022] GET /compute/v2.1/servers/7865fba9-1731-407f-a709-d60f1432e269/ips => generated 149 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:49:47.433093 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-ca58b90a-6578-4758-9d19-c7ad46e98deb tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1641371101", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-667872314", "security_groups": [{"name": "tempest-secgroup-smoke-744571343"}], "block_device_mapping_v2": [{"uuid": "3adf14f0-41ae-4f41-bd0b-abab35c2115f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3f9be41b-3ac6-43ae-b64c-2573362419af"}]}} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:49:47.445174 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_api:SELECT=28,nova_api:DELETE=1 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:49:47.571935 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.network.neutron [None req-ca58b90a-6578-4758-9d19-c7ad46e98deb tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] validate_networks() for [('3f9be41b-3ac6-43ae-b64c-2573362419af', None, None, None, None, None)] {{(pid=119658) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:49:48.164704 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-ca58b90a-6578-4758-9d19-c7ad46e98deb tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Flavor limits 0:0:0 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:49:48.165568 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-ca58b90a-6578-4758-9d19-c7ad46e98deb tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Image limits 0:0:0 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:49:48.166105 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-ca58b90a-6578-4758-9d19-c7ad46e98deb tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Flavor pref 0:0:0 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:49:48.166554 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-ca58b90a-6578-4758-9d19-c7ad46e98deb tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Image pref 0:0:0 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:49:48.167059 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-ca58b90a-6578-4758-9d19-c7ad46e98deb tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:49:48.179334 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ca58b90a-6578-4758-9d19-c7ad46e98deb tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:48.179995 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ca58b90a-6578-4758-9d19-c7ad46e98deb tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:48.180551 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ca58b90a-6578-4758-9d19-c7ad46e98deb tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:48.181443 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ca58b90a-6578-4758-9d19-c7ad46e98deb tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:48.182007 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ca58b90a-6578-4758-9d19-c7ad46e98deb tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:48.182586 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ca58b90a-6578-4758-9d19-c7ad46e98deb tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:48.206294 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.quota [None req-ca58b90a-6578-4758-9d19-c7ad46e98deb tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Getting quotas for project 990b7e753ad1450489668d0ca151736e. Resources: {'instances', 'ram', 'cores'} {{(pid=119658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:49:48.212315 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.quota [None req-ca58b90a-6578-4758-9d19-c7ad46e98deb tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Getting quotas for user 6f0516ac4c6648f9b208a89e174da3a3 and project 990b7e753ad1450489668d0ca151736e. Resources: {'instances', 'ram', 'cores'} {{(pid=119658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:49:48.293761 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-ca58b90a-6578-4758-9d19-c7ad46e98deb tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Going to run 1 instances... {{(pid=119658) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:49:48.296215 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-ca58b90a-6578-4758-9d19-c7ad46e98deb tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: 64ac4c3a-dc23-44e3-a2aa-89a6922a9279] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3adf14f0-41ae-4f41-bd0b-abab35c2115f',volume_size=None,volume_type=None)] {{(pid=119658) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:49:48.788788 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-ca58b90a-6578-4758-9d19-c7ad46e98deb tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.359843 Nov 02 14:49:48.789996 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 462/949] 10.222.0.30 () {60 vars in 1147 bytes} [Wed Nov 2 14:49:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 1362 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:49:48.802454 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-8ca64fac-22d9-4e2d-be60-7bed77c990bf tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:49:48.803172 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-8ca64fac-22d9-4e2d-be60-7bed77c990bf tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: 64ac4c3a-dc23-44e3-a2aa-89a6922a9279] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:49:48.893471 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-8ca64fac-22d9-4e2d-be60-7bed77c990bf tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:49:48.904941 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-8ca64fac-22d9-4e2d-be60-7bed77c990bf tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/64ac4c3a-dc23-44e3-a2aa-89a6922a9279" status: 200 len: 1094 microversion: 2.1 time: 0.106026 Nov 02 14:49:48.906306 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 488/950] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:49:48 2022] GET /compute/v2.1/servers/64ac4c3a-dc23-44e3-a2aa-89a6922a9279 => generated 1094 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:49:48.962946 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-07c9cc2c-ed51-41ea-b2f8-566543235699 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff4d9c19-a945-409c-a9e4-3e8c01f2fcbe"}} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:49:48.965759 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-07c9cc2c-ed51-41ea-b2f8-566543235699 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 7865fba9-1731-407f-a709-d60f1432e269] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:49:48.972744 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-07c9cc2c-ed51-41ea-b2f8-566543235699 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:48.973363 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-07c9cc2c-ed51-41ea-b2f8-566543235699 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:48.973872 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-07c9cc2c-ed51-41ea-b2f8-566543235699 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:48.974653 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-07c9cc2c-ed51-41ea-b2f8-566543235699 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:48.975170 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-07c9cc2c-ed51-41ea-b2f8-566543235699 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:48.975672 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-07c9cc2c-ed51-41ea-b2f8-566543235699 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:49.931118 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-9e4fb3cf-3637-4dff-b9b6-740140c69ec8 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:49:49.931811 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-9e4fb3cf-3637-4dff-b9b6-740140c69ec8 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: 64ac4c3a-dc23-44e3-a2aa-89a6922a9279] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:49:49.942388 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9e4fb3cf-3637-4dff-b9b6-740140c69ec8 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:49.942844 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9e4fb3cf-3637-4dff-b9b6-740140c69ec8 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:49.943373 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9e4fb3cf-3637-4dff-b9b6-740140c69ec8 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:49.944156 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9e4fb3cf-3637-4dff-b9b6-740140c69ec8 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:49.944683 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9e4fb3cf-3637-4dff-b9b6-740140c69ec8 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:49.945264 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9e4fb3cf-3637-4dff-b9b6-740140c69ec8 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:50.019062 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-07c9cc2c-ed51-41ea-b2f8-566543235699 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "POST /compute/v2.1/servers/7865fba9-1731-407f-a709-d60f1432e269/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.060277 Nov 02 14:49:50.020029 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 463/951] 10.222.0.30 () {60 vars in 1323 bytes} [Wed Nov 2 14:49:48 2022] POST /compute/v2.1/servers/7865fba9-1731-407f-a709-d60f1432e269/os-volume_attachments => generated 194 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:49:50.023477 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-9e4fb3cf-3637-4dff-b9b6-740140c69ec8 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:49:50.033187 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-9e4fb3cf-3637-4dff-b9b6-740140c69ec8 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/64ac4c3a-dc23-44e3-a2aa-89a6922a9279" status: 200 len: 1144 microversion: 2.1 time: 0.106735 Nov 02 14:49:50.033939 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 489/952] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:49:49 2022] GET /compute/v2.1/servers/64ac4c3a-dc23-44e3-a2aa-89a6922a9279 => generated 1144 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:49:51.085133 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-563ea87f-b98f-4a9b-a6ba-76d77a8f5158 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:49:51.086480 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-563ea87f-b98f-4a9b-a6ba-76d77a8f5158 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: 64ac4c3a-dc23-44e3-a2aa-89a6922a9279] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:49:51.098083 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-563ea87f-b98f-4a9b-a6ba-76d77a8f5158 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:51.100436 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-563ea87f-b98f-4a9b-a6ba-76d77a8f5158 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:51.101577 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-563ea87f-b98f-4a9b-a6ba-76d77a8f5158 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:51.102970 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-563ea87f-b98f-4a9b-a6ba-76d77a8f5158 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:51.103825 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-563ea87f-b98f-4a9b-a6ba-76d77a8f5158 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:51.104613 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-563ea87f-b98f-4a9b-a6ba-76d77a8f5158 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:51.220384 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-563ea87f-b98f-4a9b-a6ba-76d77a8f5158 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:49:51.232535 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-563ea87f-b98f-4a9b-a6ba-76d77a8f5158 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/64ac4c3a-dc23-44e3-a2aa-89a6922a9279" status: 200 len: 1192 microversion: 2.1 time: 0.157247 Nov 02 14:49:51.234063 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 464/953] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:49:51 2022] GET /compute/v2.1/servers/64ac4c3a-dc23-44e3-a2aa-89a6922a9279 => generated 1192 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:49:52.279026 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-35d31b98-9d70-413d-beb2-10813b6878b6 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:49:52.280391 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-35d31b98-9d70-413d-beb2-10813b6878b6 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: 64ac4c3a-dc23-44e3-a2aa-89a6922a9279] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:49:52.296362 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-35d31b98-9d70-413d-beb2-10813b6878b6 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:52.297806 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-35d31b98-9d70-413d-beb2-10813b6878b6 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:52.299157 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-35d31b98-9d70-413d-beb2-10813b6878b6 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:52.300798 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-35d31b98-9d70-413d-beb2-10813b6878b6 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:52.302278 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-35d31b98-9d70-413d-beb2-10813b6878b6 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:52.303714 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-35d31b98-9d70-413d-beb2-10813b6878b6 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:52.428356 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-35d31b98-9d70-413d-beb2-10813b6878b6 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:49:52.444725 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-35d31b98-9d70-413d-beb2-10813b6878b6 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/64ac4c3a-dc23-44e3-a2aa-89a6922a9279" status: 200 len: 1210 microversion: 2.1 time: 0.176133 Nov 02 14:49:52.446117 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 490/954] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:49:52 2022] GET /compute/v2.1/servers/64ac4c3a-dc23-44e3-a2aa-89a6922a9279 => generated 1210 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:49:53.495660 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-b64e323e-dec8-45cb-901d-e89fb0639316 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:49:53.496794 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-b64e323e-dec8-45cb-901d-e89fb0639316 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: 64ac4c3a-dc23-44e3-a2aa-89a6922a9279] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:49:53.506968 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b64e323e-dec8-45cb-901d-e89fb0639316 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:53.508753 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b64e323e-dec8-45cb-901d-e89fb0639316 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:53.508935 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b64e323e-dec8-45cb-901d-e89fb0639316 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:53.510234 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b64e323e-dec8-45cb-901d-e89fb0639316 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:53.510837 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b64e323e-dec8-45cb-901d-e89fb0639316 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:53.511443 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b64e323e-dec8-45cb-901d-e89fb0639316 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:53.759371 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-b64e323e-dec8-45cb-901d-e89fb0639316 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:49:53.773336 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-b64e323e-dec8-45cb-901d-e89fb0639316 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/64ac4c3a-dc23-44e3-a2aa-89a6922a9279" status: 200 len: 1277 microversion: 2.1 time: 0.281968 Nov 02 14:49:53.774437 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 465/955] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:49:53 2022] GET /compute/v2.1/servers/64ac4c3a-dc23-44e3-a2aa-89a6922a9279 => generated 1277 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:49:53.958164 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [req-cd6644b0-17ba-44c0-879c-aee54ed2056d req-1c2f8609-ef04-46d1-8779-a9107872aa43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64ac4c3a-dc23-44e3-a2aa-89a6922a9279", "tag": "8611187e-9072-476d-847c-6718440138c0"}]} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:49:53.972375 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-cd6644b0-17ba-44c0-879c-aee54ed2056d req-1c2f8609-ef04-46d1-8779-a9107872aa43 service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:53.973148 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-cd6644b0-17ba-44c0-879c-aee54ed2056d req-1c2f8609-ef04-46d1-8779-a9107872aa43 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:53.973938 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-cd6644b0-17ba-44c0-879c-aee54ed2056d req-1c2f8609-ef04-46d1-8779-a9107872aa43 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:53.994689 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.compute.server_external_events [req-cd6644b0-17ba-44c0-879c-aee54ed2056d req-1c2f8609-ef04-46d1-8779-a9107872aa43 service nova] Creating event network-changed:8611187e-9072-476d-847c-6718440138c0 for instance 64ac4c3a-dc23-44e3-a2aa-89a6922a9279 on hv-cinder-86236 Nov 02 14:49:54.003269 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [req-cd6644b0-17ba-44c0-879c-aee54ed2056d req-1c2f8609-ef04-46d1-8779-a9107872aa43 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050686 Nov 02 14:49:54.004929 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 491/956] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:49:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:49:54.817731 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-909352e2-1c3e-46d2-a660-18277d102c41 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:49:54.818775 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-909352e2-1c3e-46d2-a660-18277d102c41 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: 64ac4c3a-dc23-44e3-a2aa-89a6922a9279] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:49:54.830433 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-909352e2-1c3e-46d2-a660-18277d102c41 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:54.831287 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-909352e2-1c3e-46d2-a660-18277d102c41 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:54.832058 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-909352e2-1c3e-46d2-a660-18277d102c41 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:54.833372 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-909352e2-1c3e-46d2-a660-18277d102c41 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:54.834183 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-909352e2-1c3e-46d2-a660-18277d102c41 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:54.834944 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-909352e2-1c3e-46d2-a660-18277d102c41 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:55.045249 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-909352e2-1c3e-46d2-a660-18277d102c41 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:49:55.066239 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-909352e2-1c3e-46d2-a660-18277d102c41 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/64ac4c3a-dc23-44e3-a2aa-89a6922a9279" status: 200 len: 1277 microversion: 2.1 time: 0.255430 Nov 02 14:49:55.067773 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 466/957] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:49:54 2022] GET /compute/v2.1/servers/64ac4c3a-dc23-44e3-a2aa-89a6922a9279 => generated 1277 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:49:56.104228 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-a4569a50-1736-467a-9c29-077029e42bb6 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:49:56.106554 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-a4569a50-1736-467a-9c29-077029e42bb6 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: 64ac4c3a-dc23-44e3-a2aa-89a6922a9279] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:49:56.114847 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a4569a50-1736-467a-9c29-077029e42bb6 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:56.115395 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a4569a50-1736-467a-9c29-077029e42bb6 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:56.115881 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a4569a50-1736-467a-9c29-077029e42bb6 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:56.116708 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a4569a50-1736-467a-9c29-077029e42bb6 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:56.117321 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a4569a50-1736-467a-9c29-077029e42bb6 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:56.118301 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a4569a50-1736-467a-9c29-077029e42bb6 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:56.292660 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-a4569a50-1736-467a-9c29-077029e42bb6 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:49:56.301457 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-a4569a50-1736-467a-9c29-077029e42bb6 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/64ac4c3a-dc23-44e3-a2aa-89a6922a9279" status: 200 len: 1277 microversion: 2.1 time: 0.202481 Nov 02 14:49:56.302048 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 492/958] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:49:56 2022] GET /compute/v2.1/servers/64ac4c3a-dc23-44e3-a2aa-89a6922a9279 => generated 1277 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:49:57.330439 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-15df4b93-05f2-4a50-9f82-f1b18b737297 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:49:57.331342 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-15df4b93-05f2-4a50-9f82-f1b18b737297 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: 64ac4c3a-dc23-44e3-a2aa-89a6922a9279] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:49:57.340069 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-15df4b93-05f2-4a50-9f82-f1b18b737297 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:57.340680 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-15df4b93-05f2-4a50-9f82-f1b18b737297 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:57.341291 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-15df4b93-05f2-4a50-9f82-f1b18b737297 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:57.342230 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-15df4b93-05f2-4a50-9f82-f1b18b737297 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:57.342731 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-15df4b93-05f2-4a50-9f82-f1b18b737297 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:57.343287 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-15df4b93-05f2-4a50-9f82-f1b18b737297 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:57.498986 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-15df4b93-05f2-4a50-9f82-f1b18b737297 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:49:57.512308 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-15df4b93-05f2-4a50-9f82-f1b18b737297 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/64ac4c3a-dc23-44e3-a2aa-89a6922a9279" status: 200 len: 1277 microversion: 2.1 time: 0.184505 Nov 02 14:49:57.512308 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 467/959] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:49:57 2022] GET /compute/v2.1/servers/64ac4c3a-dc23-44e3-a2aa-89a6922a9279 => generated 1277 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:49:58.202075 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-2b69873a-13a3-41ca-ae80-170798d1b924 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff4d9c19-a945-409c-a9e4-3e8c01f2fcbe"}} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:49:58.204418 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-2b69873a-13a3-41ca-ae80-170798d1b924 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 7865fba9-1731-407f-a709-d60f1432e269] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:49:58.211257 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2b69873a-13a3-41ca-ae80-170798d1b924 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:58.211737 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2b69873a-13a3-41ca-ae80-170798d1b924 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:58.212167 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2b69873a-13a3-41ca-ae80-170798d1b924 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:58.212869 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2b69873a-13a3-41ca-ae80-170798d1b924 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:58.213346 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2b69873a-13a3-41ca-ae80-170798d1b924 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:58.213766 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2b69873a-13a3-41ca-ae80-170798d1b924 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:58.298716 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.wsgi [None req-2b69873a-13a3-41ca-ae80-170798d1b924 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] HTTP exception thrown: Invalid volume: volume ff4d9c19-a945-409c-a9e4-3e8c01f2fcbe is already attached to instances: 7865fba9-1731-407f-a709-d60f1432e269 Nov 02 14:49:58.300507 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-2b69873a-13a3-41ca-ae80-170798d1b924 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Request method failure captured: Nov 02 14:49:58.300507 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: request: POST /compute/v2.1/servers/7865fba9-1731-407f-a709-d60f1432e269/os-volume_attachments HTTP/1.1 Nov 02 14:49:58.300507 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Accept: application/json Nov 02 14:49:58.300507 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Accept-Encoding: identity Nov 02 14:49:58.300507 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Connection: close Nov 02 14:49:58.300507 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Content-Length: 74 Nov 02 14:49:58.300507 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Content-Type: application/json Nov 02 14:49:58.300507 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Host: 10.222.0.30 Nov 02 14:49:58.300507 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Openstack-System-Scope: None Nov 02 14:49:58.300507 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: User-Agent: python-urllib3/1.26.12 Nov 02 14:49:58.300507 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Auth-Token: gAAAAABjYoLLvHsLbLP8fTVuFWPOl6OBOImR3Z5sy0YBc5pcdW4rsQGD2999fEEKagme5Rl64Y-6rgjuI819nWAO1ogYJFLnm9s-YT3gxgnSb4U1lYBBYG0Hxitg6Xb3tz5FVnIsGEbww8BWoFWN4RSJnQNLjjxID_ZFkIwIYop5btRshsuXhyM Nov 02 14:49:58.300507 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Domain-Id: None Nov 02 14:49:58.300507 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Domain-Name: None Nov 02 14:49:58.300507 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Identity-Status: Confirmed Nov 02 14:49:58.300507 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Is-Admin-Project: True Nov 02 14:49:58.300507 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Domain-Id: default Nov 02 14:49:58.300507 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Domain-Name: Default Nov 02 14:49:58.300507 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Id: e428f318654f446db48445e4570ae2d3 Nov 02 14:49:58.300507 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Name: tempest-AttachVolumeNegativeTest-1274711238 Nov 02 14:49:58.300507 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Role: reader,member Nov 02 14:49:58.300507 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Roles: reader,member Nov 02 14:49:58.302300 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e428f318654f446db48445e4570ae2d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e428f318654f446db48445e4570ae2d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e428f318654f446db48445e4570ae2d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e428f318654f446db48445e4570ae2d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:49:58.302300 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant: tempest-AttachVolumeNegativeTest-1274711238 Nov 02 14:49:58.302300 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant-Id: e428f318654f446db48445e4570ae2d3 Nov 02 14:49:58.302300 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1274711238 Nov 02 14:49:58.302300 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User: tempest-AttachVolumeNegativeTest-1274711238-project Nov 02 14:49:58.302300 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Domain-Id: default Nov 02 14:49:58.302300 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Domain-Name: Default Nov 02 14:49:58.302300 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Id: 7fa761a568644a9399d825498a51f054 Nov 02 14:49:58.302300 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Name: tempest-AttachVolumeNegativeTest-1274711238-project Nov 02 14:49:58.302300 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Nov 02 14:49:58.302300 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: {"volumeAttachment": {"volumeId": "ff4d9c19-a945-409c-a9e4-3e8c01f2fcbe"}} Nov 02 14:49:58.302300 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: method: > Nov 02 14:49:58.303226 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: exception: Invalid volume: volume ff4d9c19-a945-409c-a9e4-3e8c01f2fcbe is already attached to instances: 7865fba9-1731-407f-a709-d60f1432e269 Nov 02 14:49:58.303226 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: action_args: {'server_id': '7865fba9-1731-407f-a709-d60f1432e269', 'body': {'volumeAttachment': {'volumeId': 'ff4d9c19-a945-409c-a9e4-3e8c01f2fcbe'}}} Nov 02 14:49:58.303226 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:49:58.303226 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:49:58.303226 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Nov 02 14:49:58.303226 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Nov 02 14:49:58.303226 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 14:49:58.303226 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 14:49:58.303226 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Nov 02 14:49:58.303226 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 14:49:58.303226 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Nov 02 14:49:58.303226 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Nov 02 14:49:58.303226 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Nov 02 14:49:58.303226 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Nov 02 14:49:58.303226 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ff4d9c19-a945-409c-a9e4-3e8c01f2fcbe is already attached to instances: 7865fba9-1731-407f-a709-d60f1432e269 Nov 02 14:49:58.303226 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:49:58.303226 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:49:58.303226 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:49:58.303226 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:49:58.304721 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:49:58.304721 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:49:58.304721 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:49:58.304721 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:49:58.304721 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:49:58.304721 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:49:58.304721 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:49:58.304721 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:49:58.304721 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:49:58.304721 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:49:58.304721 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:49:58.304721 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:49:58.304721 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Nov 02 14:49:58.304721 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Nov 02 14:49:58.304721 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ff4d9c19-a945-409c-a9e4-3e8c01f2fcbe is already attached to instances: 7865fba9-1731-407f-a709-d60f1432e269 Nov 02 14:49:58.304721 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:49:58.304721 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:49:58.304721 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:49:58.304721 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:49:58.304721 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:49:58.307404 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:49:58.307404 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:49:58.307404 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:49:58.307404 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ff4d9c19-a945-409c-a9e4-3e8c01f2fcbe is already attached to instances: 7865fba9-1731-407f-a709-d60f1432e269 Nov 02 14:49:58.307404 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:49:58.307404 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-2b69873a-13a3-41ca-ae80-170798d1b924 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Returning 400 to user: Invalid volume: volume ff4d9c19-a945-409c-a9e4-3e8c01f2fcbe is already attached to instances: 7865fba9-1731-407f-a709-d60f1432e269 {{(pid=119659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:49:58.307404 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-2b69873a-13a3-41ca-ae80-170798d1b924 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "POST /compute/v2.1/servers/7865fba9-1731-407f-a709-d60f1432e269/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.104645 Nov 02 14:49:58.307404 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 493/960] 10.222.0.30 () {60 vars in 1323 bytes} [Wed Nov 2 14:49:58 2022] POST /compute/v2.1/servers/7865fba9-1731-407f-a709-d60f1432e269/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 14:49:58.378343 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-413746b8-e04b-4d25-9138-f92048369be2 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:49:58.378979 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-413746b8-e04b-4d25-9138-f92048369be2 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 7865fba9-1731-407f-a709-d60f1432e269] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:49:58.381354 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell0:SELECT=2 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:49:58.382386 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell0:SELECT=6 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:49:58.389943 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-413746b8-e04b-4d25-9138-f92048369be2 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:58.392712 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-413746b8-e04b-4d25-9138-f92048369be2 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:58.392712 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-413746b8-e04b-4d25-9138-f92048369be2 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:58.392712 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-413746b8-e04b-4d25-9138-f92048369be2 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:58.392712 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-413746b8-e04b-4d25-9138-f92048369be2 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:58.393376 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-413746b8-e04b-4d25-9138-f92048369be2 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:58.501189 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.objects.instance [None req-413746b8-e04b-4d25-9138-f92048369be2 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lazy-loading 'services' on Instance uuid 7865fba9-1731-407f-a709-d60f1432e269 {{(pid=119658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:49:58.540739 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-8f791baa-9090-4ace-8ac6-49323b0523d1 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:49:58.541622 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-8f791baa-9090-4ace-8ac6-49323b0523d1 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: 64ac4c3a-dc23-44e3-a2aa-89a6922a9279] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:49:58.548759 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8f791baa-9090-4ace-8ac6-49323b0523d1 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:58.549300 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8f791baa-9090-4ace-8ac6-49323b0523d1 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:58.549749 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8f791baa-9090-4ace-8ac6-49323b0523d1 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:58.550488 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8f791baa-9090-4ace-8ac6-49323b0523d1 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:58.550997 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8f791baa-9090-4ace-8ac6-49323b0523d1 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:58.551434 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8f791baa-9090-4ace-8ac6-49323b0523d1 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:58.707710 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-8f791baa-9090-4ace-8ac6-49323b0523d1 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:49:58.717149 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-8f791baa-9090-4ace-8ac6-49323b0523d1 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/64ac4c3a-dc23-44e3-a2aa-89a6922a9279" status: 200 len: 1277 microversion: 2.1 time: 0.181390 Nov 02 14:49:58.717753 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 494/961] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:49:58 2022] GET /compute/v2.1/servers/64ac4c3a-dc23-44e3-a2aa-89a6922a9279 => generated 1277 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:49:58.745375 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-413746b8-e04b-4d25-9138-f92048369be2 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7865fba9-1731-407f-a709-d60f1432e269/os-volume_attachments/ff4d9c19-a945-409c-a9e4-3e8c01f2fcbe" status: 202 len: 0 microversion: 2.1 time: 0.371443 Nov 02 14:49:58.749258 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 468/962] 10.222.0.30 () {58 vars in 1416 bytes} [Wed Nov 2 14:49:58 2022] DELETE /compute/v2.1/servers/7865fba9-1731-407f-a709-d60f1432e269/os-volume_attachments/ff4d9c19-a945-409c-a9e4-3e8c01f2fcbe => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:49:58.758066 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-97248bca-734c-41cf-9a90-5dbe4c5f2b2f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:49:58.761134 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-97248bca-734c-41cf-9a90-5dbe4c5f2b2f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 7865fba9-1731-407f-a709-d60f1432e269] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:49:58.772820 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-97248bca-734c-41cf-9a90-5dbe4c5f2b2f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:58.773438 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-97248bca-734c-41cf-9a90-5dbe4c5f2b2f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:58.777678 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-97248bca-734c-41cf-9a90-5dbe4c5f2b2f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:58.777678 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-97248bca-734c-41cf-9a90-5dbe4c5f2b2f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:58.777678 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-97248bca-734c-41cf-9a90-5dbe4c5f2b2f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:58.777678 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-97248bca-734c-41cf-9a90-5dbe4c5f2b2f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:58.811215 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-97248bca-734c-41cf-9a90-5dbe4c5f2b2f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/7865fba9-1731-407f-a709-d60f1432e269/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057832 Nov 02 14:49:58.811810 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 495/963] 10.222.0.30 () {58 vars in 1302 bytes} [Wed Nov 2 14:49:58 2022] GET /compute/v2.1/servers/7865fba9-1731-407f-a709-d60f1432e269/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:49:59.742971 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-b0b592d8-ceca-46a5-b0d2-8529235fc80d tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:49:59.744031 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-b0b592d8-ceca-46a5-b0d2-8529235fc80d tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: 64ac4c3a-dc23-44e3-a2aa-89a6922a9279] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:49:59.751756 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b0b592d8-ceca-46a5-b0d2-8529235fc80d tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:59.752254 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b0b592d8-ceca-46a5-b0d2-8529235fc80d tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:59.752691 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b0b592d8-ceca-46a5-b0d2-8529235fc80d tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:59.753506 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b0b592d8-ceca-46a5-b0d2-8529235fc80d tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:59.754069 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b0b592d8-ceca-46a5-b0d2-8529235fc80d tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:59.754493 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b0b592d8-ceca-46a5-b0d2-8529235fc80d tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:59.828119 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-98cae9fd-249b-45a2-bffc-0843e9489800 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:49:59.835848 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-98cae9fd-249b-45a2-bffc-0843e9489800 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 7865fba9-1731-407f-a709-d60f1432e269] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:49:59.835848 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell0:SELECT=2 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:49:59.839261 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-98cae9fd-249b-45a2-bffc-0843e9489800 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:59.839766 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-98cae9fd-249b-45a2-bffc-0843e9489800 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:59.840194 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-98cae9fd-249b-45a2-bffc-0843e9489800 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:59.841224 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-98cae9fd-249b-45a2-bffc-0843e9489800 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:59.841840 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-98cae9fd-249b-45a2-bffc-0843e9489800 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:59.842422 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-98cae9fd-249b-45a2-bffc-0843e9489800 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:59.888461 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-98cae9fd-249b-45a2-bffc-0843e9489800 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/7865fba9-1731-407f-a709-d60f1432e269/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067421 Nov 02 14:49:59.890082 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 496/964] 10.222.0.30 () {58 vars in 1302 bytes} [Wed Nov 2 14:49:59 2022] GET /compute/v2.1/servers/7865fba9-1731-407f-a709-d60f1432e269/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:49:59.953893 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-b0b592d8-ceca-46a5-b0d2-8529235fc80d tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:49:59.967830 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-b0b592d8-ceca-46a5-b0d2-8529235fc80d tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/64ac4c3a-dc23-44e3-a2aa-89a6922a9279" status: 200 len: 1265 microversion: 2.1 time: 0.229726 Nov 02 14:49:59.969181 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 469/965] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:49:59 2022] GET /compute/v2.1/servers/64ac4c3a-dc23-44e3-a2aa-89a6922a9279 => generated 1265 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:50:00.910035 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-3c44c3b2-8a59-417e-8852-02bdda2b7e93 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:50:00.913815 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-3c44c3b2-8a59-417e-8852-02bdda2b7e93 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 7865fba9-1731-407f-a709-d60f1432e269] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:50:00.926873 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3c44c3b2-8a59-417e-8852-02bdda2b7e93 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:00.927745 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3c44c3b2-8a59-417e-8852-02bdda2b7e93 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:00.928693 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3c44c3b2-8a59-417e-8852-02bdda2b7e93 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:00.929803 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3c44c3b2-8a59-417e-8852-02bdda2b7e93 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:00.930631 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3c44c3b2-8a59-417e-8852-02bdda2b7e93 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:00.931395 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3c44c3b2-8a59-417e-8852-02bdda2b7e93 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:00.989514 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-3c44c3b2-8a59-417e-8852-02bdda2b7e93 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/7865fba9-1731-407f-a709-d60f1432e269/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.087337 Nov 02 14:50:00.990561 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 497/966] 10.222.0.30 () {58 vars in 1302 bytes} [Wed Nov 2 14:50:00 2022] GET /compute/v2.1/servers/7865fba9-1731-407f-a709-d60f1432e269/os-volume_attachments => generated 25 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 14:50:00.992878 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-3efd2002-779f-444e-bbbb-d3142bf56e83 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:50:00.993883 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-3efd2002-779f-444e-bbbb-d3142bf56e83 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: 64ac4c3a-dc23-44e3-a2aa-89a6922a9279] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:50:01.001571 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3efd2002-779f-444e-bbbb-d3142bf56e83 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:01.002064 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3efd2002-779f-444e-bbbb-d3142bf56e83 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:01.002501 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3efd2002-779f-444e-bbbb-d3142bf56e83 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:01.003435 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3efd2002-779f-444e-bbbb-d3142bf56e83 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:01.003656 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3efd2002-779f-444e-bbbb-d3142bf56e83 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:01.004083 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3efd2002-779f-444e-bbbb-d3142bf56e83 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:01.073144 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-0c59c98f-116d-40c2-ba3d-bb2967efa4de tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:50:01.074736 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-0c59c98f-116d-40c2-ba3d-bb2967efa4de tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 7865fba9-1731-407f-a709-d60f1432e269] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:50:01.088284 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0c59c98f-116d-40c2-ba3d-bb2967efa4de tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:01.089612 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0c59c98f-116d-40c2-ba3d-bb2967efa4de tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:01.091417 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0c59c98f-116d-40c2-ba3d-bb2967efa4de tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:01.092708 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0c59c98f-116d-40c2-ba3d-bb2967efa4de tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:01.093587 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0c59c98f-116d-40c2-ba3d-bb2967efa4de tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:01.094352 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0c59c98f-116d-40c2-ba3d-bb2967efa4de tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:01.145099 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-0c59c98f-116d-40c2-ba3d-bb2967efa4de tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 7865fba9-1731-407f-a709-d60f1432e269] Going to try to terminate instance {{(pid=119659) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:50:01.200893 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-3efd2002-779f-444e-bbbb-d3142bf56e83 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:50:01.211909 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-3efd2002-779f-444e-bbbb-d3142bf56e83 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/64ac4c3a-dc23-44e3-a2aa-89a6922a9279" status: 200 len: 1265 microversion: 2.1 time: 0.223540 Nov 02 14:50:01.213277 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 470/967] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:50:00 2022] GET /compute/v2.1/servers/64ac4c3a-dc23-44e3-a2aa-89a6922a9279 => generated 1265 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:50:01.524572 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-0c59c98f-116d-40c2-ba3d-bb2967efa4de tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7865fba9-1731-407f-a709-d60f1432e269" status: 204 len: 0 microversion: 2.1 time: 0.458223 Nov 02 14:50:01.525807 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 498/968] 10.222.0.30 () {58 vars in 1239 bytes} [Wed Nov 2 14:50:01 2022] DELETE /compute/v2.1/servers/7865fba9-1731-407f-a709-d60f1432e269 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:50:01.542342 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-8176b868-3869-4826-8537-35135b8de7fb tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:50:01.543170 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-8176b868-3869-4826-8537-35135b8de7fb tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 7865fba9-1731-407f-a709-d60f1432e269] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:50:01.553349 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8176b868-3869-4826-8537-35135b8de7fb tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:01.554123 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8176b868-3869-4826-8537-35135b8de7fb tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:01.554842 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8176b868-3869-4826-8537-35135b8de7fb tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:01.556022 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8176b868-3869-4826-8537-35135b8de7fb tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:01.556791 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8176b868-3869-4826-8537-35135b8de7fb tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:01.557543 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8176b868-3869-4826-8537-35135b8de7fb tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:01.712223 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-8176b868-3869-4826-8537-35135b8de7fb tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:50:01.721337 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-8176b868-3869-4826-8537-35135b8de7fb tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/7865fba9-1731-407f-a709-d60f1432e269" status: 200 len: 1679 microversion: 2.1 time: 0.185566 Nov 02 14:50:01.721952 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 471/969] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:50:01 2022] GET /compute/v2.1/servers/7865fba9-1731-407f-a709-d60f1432e269 => generated 1679 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:50:02.253238 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-14b2ee4c-c29c-430f-8ed8-619238bf22c0 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:50:02.254229 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-14b2ee4c-c29c-430f-8ed8-619238bf22c0 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: 64ac4c3a-dc23-44e3-a2aa-89a6922a9279] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:50:02.262722 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-14b2ee4c-c29c-430f-8ed8-619238bf22c0 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:02.263204 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-14b2ee4c-c29c-430f-8ed8-619238bf22c0 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:02.265401 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-14b2ee4c-c29c-430f-8ed8-619238bf22c0 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:02.265401 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-14b2ee4c-c29c-430f-8ed8-619238bf22c0 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:02.265401 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-14b2ee4c-c29c-430f-8ed8-619238bf22c0 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:02.265401 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-14b2ee4c-c29c-430f-8ed8-619238bf22c0 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:02.461323 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-14b2ee4c-c29c-430f-8ed8-619238bf22c0 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:50:02.471431 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-14b2ee4c-c29c-430f-8ed8-619238bf22c0 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/64ac4c3a-dc23-44e3-a2aa-89a6922a9279" status: 200 len: 1265 microversion: 2.1 time: 0.222551 Nov 02 14:50:02.472295 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 499/970] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:50:02 2022] GET /compute/v2.1/servers/64ac4c3a-dc23-44e3-a2aa-89a6922a9279 => generated 1265 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:50:02.748016 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-c70c01b8-c0ca-4855-9b44-0816a922febf tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:50:02.749185 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-c70c01b8-c0ca-4855-9b44-0816a922febf tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 7865fba9-1731-407f-a709-d60f1432e269] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:50:02.758322 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c70c01b8-c0ca-4855-9b44-0816a922febf tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:02.758938 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c70c01b8-c0ca-4855-9b44-0816a922febf tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:02.759618 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c70c01b8-c0ca-4855-9b44-0816a922febf tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:02.760482 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c70c01b8-c0ca-4855-9b44-0816a922febf tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:02.761212 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c70c01b8-c0ca-4855-9b44-0816a922febf tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:02.762084 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c70c01b8-c0ca-4855-9b44-0816a922febf tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:02.927185 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-c70c01b8-c0ca-4855-9b44-0816a922febf tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:50:02.936198 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-c70c01b8-c0ca-4855-9b44-0816a922febf tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/7865fba9-1731-407f-a709-d60f1432e269" status: 200 len: 1679 microversion: 2.1 time: 0.193415 Nov 02 14:50:02.936777 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 472/971] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:50:02 2022] GET /compute/v2.1/servers/7865fba9-1731-407f-a709-d60f1432e269 => generated 1679 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:50:03.498684 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-77b782d2-5597-499f-830f-cc9e88069b8d tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:50:03.499374 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-77b782d2-5597-499f-830f-cc9e88069b8d tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: 64ac4c3a-dc23-44e3-a2aa-89a6922a9279] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:50:03.506479 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-77b782d2-5597-499f-830f-cc9e88069b8d tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:03.506956 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-77b782d2-5597-499f-830f-cc9e88069b8d tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:03.507389 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-77b782d2-5597-499f-830f-cc9e88069b8d tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:03.508095 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-77b782d2-5597-499f-830f-cc9e88069b8d tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:03.508543 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-77b782d2-5597-499f-830f-cc9e88069b8d tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:03.508955 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-77b782d2-5597-499f-830f-cc9e88069b8d tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:03.787893 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-77b782d2-5597-499f-830f-cc9e88069b8d tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:50:03.798871 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-77b782d2-5597-499f-830f-cc9e88069b8d tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/64ac4c3a-dc23-44e3-a2aa-89a6922a9279" status: 200 len: 1265 microversion: 2.1 time: 0.304463 Nov 02 14:50:03.799612 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 500/972] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:50:03 2022] GET /compute/v2.1/servers/64ac4c3a-dc23-44e3-a2aa-89a6922a9279 => generated 1265 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:50:03.965403 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-11b72a8e-b32f-4eec-981c-4f58b5d30211 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:50:03.966921 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-11b72a8e-b32f-4eec-981c-4f58b5d30211 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 7865fba9-1731-407f-a709-d60f1432e269] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:50:03.980151 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-11b72a8e-b32f-4eec-981c-4f58b5d30211 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:03.981779 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-11b72a8e-b32f-4eec-981c-4f58b5d30211 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:03.982877 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-11b72a8e-b32f-4eec-981c-4f58b5d30211 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:03.984275 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-11b72a8e-b32f-4eec-981c-4f58b5d30211 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:03.985227 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-11b72a8e-b32f-4eec-981c-4f58b5d30211 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:03.986071 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-11b72a8e-b32f-4eec-981c-4f58b5d30211 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:04.336604 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-11b72a8e-b32f-4eec-981c-4f58b5d30211 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:50:04.349288 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-11b72a8e-b32f-4eec-981c-4f58b5d30211 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/7865fba9-1731-407f-a709-d60f1432e269" status: 200 len: 1679 microversion: 2.1 time: 0.389949 Nov 02 14:50:04.350770 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 473/973] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:50:03 2022] GET /compute/v2.1/servers/7865fba9-1731-407f-a709-d60f1432e269 => generated 1679 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:50:04.665704 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [req-3204d2a3-28db-4859-9515-06bac024ac21 req-e6ca71ef-f8d3-4a97-a2ff-41e168a8746f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7865fba9-1731-407f-a709-d60f1432e269", "name": "network-vif-deleted", "tag": "c155ea33-0bb7-4da9-8b7e-40ccb265ead9"}]} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:50:04.682362 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-3204d2a3-28db-4859-9515-06bac024ac21 req-e6ca71ef-f8d3-4a97-a2ff-41e168a8746f service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:04.683821 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-3204d2a3-28db-4859-9515-06bac024ac21 req-e6ca71ef-f8d3-4a97-a2ff-41e168a8746f service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:04.685359 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-3204d2a3-28db-4859-9515-06bac024ac21 req-e6ca71ef-f8d3-4a97-a2ff-41e168a8746f service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:04.703703 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.compute.server_external_events [req-3204d2a3-28db-4859-9515-06bac024ac21 req-e6ca71ef-f8d3-4a97-a2ff-41e168a8746f service nova] Creating event network-vif-deleted:c155ea33-0bb7-4da9-8b7e-40ccb265ead9 for instance 7865fba9-1731-407f-a709-d60f1432e269 on hv-cinder-86236 Nov 02 14:50:04.718605 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [req-3204d2a3-28db-4859-9515-06bac024ac21 req-e6ca71ef-f8d3-4a97-a2ff-41e168a8746f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057220 Nov 02 14:50:04.719873 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 501/974] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:50:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:50:04.830380 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-f2df2457-8833-4adb-a5c3-e8f058a3b53c tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:50:04.831997 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-f2df2457-8833-4adb-a5c3-e8f058a3b53c tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: 64ac4c3a-dc23-44e3-a2aa-89a6922a9279] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:50:04.844850 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f2df2457-8833-4adb-a5c3-e8f058a3b53c tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:04.846550 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f2df2457-8833-4adb-a5c3-e8f058a3b53c tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:04.847949 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f2df2457-8833-4adb-a5c3-e8f058a3b53c tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:04.849849 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f2df2457-8833-4adb-a5c3-e8f058a3b53c tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:04.851356 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f2df2457-8833-4adb-a5c3-e8f058a3b53c tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:04.852406 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f2df2457-8833-4adb-a5c3-e8f058a3b53c tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:05.095213 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-f2df2457-8833-4adb-a5c3-e8f058a3b53c tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:50:05.111364 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-f2df2457-8833-4adb-a5c3-e8f058a3b53c tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/64ac4c3a-dc23-44e3-a2aa-89a6922a9279" status: 200 len: 1265 microversion: 2.1 time: 0.288842 Nov 02 14:50:05.112379 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 474/975] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:50:04 2022] GET /compute/v2.1/servers/64ac4c3a-dc23-44e3-a2aa-89a6922a9279 => generated 1265 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:50:05.380791 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-3bda3c2d-df88-4fd7-8b06-c62920cf3d66 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:50:05.382483 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-3bda3c2d-df88-4fd7-8b06-c62920cf3d66 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 7865fba9-1731-407f-a709-d60f1432e269] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:50:05.395649 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3bda3c2d-df88-4fd7-8b06-c62920cf3d66 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:05.396560 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3bda3c2d-df88-4fd7-8b06-c62920cf3d66 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:05.397494 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3bda3c2d-df88-4fd7-8b06-c62920cf3d66 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:05.398774 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3bda3c2d-df88-4fd7-8b06-c62920cf3d66 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:05.399611 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3bda3c2d-df88-4fd7-8b06-c62920cf3d66 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:05.400646 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3bda3c2d-df88-4fd7-8b06-c62920cf3d66 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:05.560743 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-3bda3c2d-df88-4fd7-8b06-c62920cf3d66 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:50:05.570500 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-3bda3c2d-df88-4fd7-8b06-c62920cf3d66 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/7865fba9-1731-407f-a709-d60f1432e269" status: 200 len: 1325 microversion: 2.1 time: 0.197717 Nov 02 14:50:05.572208 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 502/976] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:50:05 2022] GET /compute/v2.1/servers/7865fba9-1731-407f-a709-d60f1432e269 => generated 1325 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:50:06.137692 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-bb931244-46a2-4cbf-8852-501276e3066a tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:50:06.138314 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-bb931244-46a2-4cbf-8852-501276e3066a tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: 64ac4c3a-dc23-44e3-a2aa-89a6922a9279] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:50:06.151680 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-bb931244-46a2-4cbf-8852-501276e3066a tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:06.152227 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-bb931244-46a2-4cbf-8852-501276e3066a tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:06.152675 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-bb931244-46a2-4cbf-8852-501276e3066a tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:06.153477 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-bb931244-46a2-4cbf-8852-501276e3066a tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:06.158273 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-bb931244-46a2-4cbf-8852-501276e3066a tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:06.158273 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-bb931244-46a2-4cbf-8852-501276e3066a tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:06.305328 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-bb931244-46a2-4cbf-8852-501276e3066a tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:50:06.314551 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-bb931244-46a2-4cbf-8852-501276e3066a tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/64ac4c3a-dc23-44e3-a2aa-89a6922a9279" status: 200 len: 1265 microversion: 2.1 time: 0.182205 Nov 02 14:50:06.315055 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 475/977] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:50:06 2022] GET /compute/v2.1/servers/64ac4c3a-dc23-44e3-a2aa-89a6922a9279 => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:50:06.607425 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-4a1105bf-a2c3-4c0a-8728-378297708438 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:50:06.608152 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-4a1105bf-a2c3-4c0a-8728-378297708438 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 7865fba9-1731-407f-a709-d60f1432e269] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:50:06.614965 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4a1105bf-a2c3-4c0a-8728-378297708438 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:06.615536 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4a1105bf-a2c3-4c0a-8728-378297708438 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:06.619040 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4a1105bf-a2c3-4c0a-8728-378297708438 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:06.619040 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4a1105bf-a2c3-4c0a-8728-378297708438 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:06.619040 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4a1105bf-a2c3-4c0a-8728-378297708438 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:06.619040 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4a1105bf-a2c3-4c0a-8728-378297708438 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:06.633561 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.wsgi [None req-4a1105bf-a2c3-4c0a-8728-378297708438 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] HTTP exception thrown: Instance 7865fba9-1731-407f-a709-d60f1432e269 could not be found. Nov 02 14:50:06.635295 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-4a1105bf-a2c3-4c0a-8728-378297708438 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Request method failure captured: Nov 02 14:50:06.635295 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: request: GET /compute/v2.1/servers/7865fba9-1731-407f-a709-d60f1432e269 HTTP/1.1 Nov 02 14:50:06.635295 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Accept: application/json Nov 02 14:50:06.635295 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Accept-Encoding: identity Nov 02 14:50:06.635295 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Connection: close Nov 02 14:50:06.635295 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Content-Length: 0 Nov 02 14:50:06.635295 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Content-Type: application/json Nov 02 14:50:06.635295 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Host: 10.222.0.30 Nov 02 14:50:06.635295 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Openstack-System-Scope: None Nov 02 14:50:06.635295 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: User-Agent: python-urllib3/1.26.12 Nov 02 14:50:06.635295 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Auth-Token: gAAAAABjYoLLvHsLbLP8fTVuFWPOl6OBOImR3Z5sy0YBc5pcdW4rsQGD2999fEEKagme5Rl64Y-6rgjuI819nWAO1ogYJFLnm9s-YT3gxgnSb4U1lYBBYG0Hxitg6Xb3tz5FVnIsGEbww8BWoFWN4RSJnQNLjjxID_ZFkIwIYop5btRshsuXhyM Nov 02 14:50:06.635295 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Domain-Id: None Nov 02 14:50:06.635295 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Domain-Name: None Nov 02 14:50:06.635295 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Identity-Status: Confirmed Nov 02 14:50:06.635295 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Is-Admin-Project: True Nov 02 14:50:06.635295 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Domain-Id: default Nov 02 14:50:06.635295 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Domain-Name: Default Nov 02 14:50:06.635295 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Id: e428f318654f446db48445e4570ae2d3 Nov 02 14:50:06.635295 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Name: tempest-AttachVolumeNegativeTest-1274711238 Nov 02 14:50:06.635295 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Role: reader,member Nov 02 14:50:06.635295 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Roles: reader,member Nov 02 14:50:06.637693 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e428f318654f446db48445e4570ae2d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e428f318654f446db48445e4570ae2d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e428f318654f446db48445e4570ae2d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e428f318654f446db48445e4570ae2d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:50:06.637693 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant: tempest-AttachVolumeNegativeTest-1274711238 Nov 02 14:50:06.637693 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant-Id: e428f318654f446db48445e4570ae2d3 Nov 02 14:50:06.637693 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1274711238 Nov 02 14:50:06.637693 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User: tempest-AttachVolumeNegativeTest-1274711238-project Nov 02 14:50:06.637693 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Domain-Id: default Nov 02 14:50:06.637693 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Domain-Name: Default Nov 02 14:50:06.637693 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Id: 7fa761a568644a9399d825498a51f054 Nov 02 14:50:06.637693 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Name: tempest-AttachVolumeNegativeTest-1274711238-project Nov 02 14:50:06.637693 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: method: > Nov 02 14:50:06.637693 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: exception: Instance 7865fba9-1731-407f-a709-d60f1432e269 could not be found. Nov 02 14:50:06.637693 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: action_args: {'id': '7865fba9-1731-407f-a709-d60f1432e269'} Nov 02 14:50:06.638503 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:50:06.638503 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:50:06.638503 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:50:06.638503 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:50:06.638503 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:50:06.638503 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:50:06.638503 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:50:06.638503 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:50:06.638503 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:50:06.638503 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:50:06.638503 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7865fba9-1731-407f-a709-d60f1432e269 could not be found. Nov 02 14:50:06.638503 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:50:06.638503 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:50:06.638503 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:50:06.638503 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:50:06.638503 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:50:06.638503 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:50:06.638503 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:50:06.638503 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:50:06.638503 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:50:06.639763 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:50:06.639763 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:50:06.639763 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:50:06.639763 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:50:06.639763 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:50:06.639763 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:50:06.639763 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:50:06.639763 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7865fba9-1731-407f-a709-d60f1432e269 could not be found. Nov 02 14:50:06.639763 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:50:06.639763 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:50:06.639763 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:50:06.639763 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:50:06.639763 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:50:06.639763 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:50:06.639763 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:50:06.639763 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:50:06.639763 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7865fba9-1731-407f-a709-d60f1432e269 could not be found. Nov 02 14:50:06.639763 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:50:06.641023 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-4a1105bf-a2c3-4c0a-8728-378297708438 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Returning 404 to user: Instance 7865fba9-1731-407f-a709-d60f1432e269 could not be found. {{(pid=119659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:50:06.641023 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-4a1105bf-a2c3-4c0a-8728-378297708438 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/7865fba9-1731-407f-a709-d60f1432e269" status: 404 len: 111 microversion: 2.1 time: 0.034093 Nov 02 14:50:06.641023 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 503/978] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:50:06 2022] GET /compute/v2.1/servers/7865fba9-1731-407f-a709-d60f1432e269 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 14:50:06.647916 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-c1cfda16-3c58-47fa-b8fc-b3b99ab49536 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '.version_select at 0x7fb24ed36280>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:50:06.728828 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-c1cfda16-3c58-47fa-b8fc-b3b99ab49536 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-109845735" status: 202 len: 0 microversion: 2.1 time: 0.084956 Nov 02 14:50:06.729461 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 476/979] 10.222.0.30 () {58 vars in 1218 bytes} [Wed Nov 2 14:50:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-109845735 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:50:07.346640 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-6e98ee89-07f6-4de3-a702-47cf7a584537 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:50:07.346640 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-6e98ee89-07f6-4de3-a702-47cf7a584537 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: 64ac4c3a-dc23-44e3-a2aa-89a6922a9279] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:50:07.348561 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6e98ee89-07f6-4de3-a702-47cf7a584537 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:07.349066 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6e98ee89-07f6-4de3-a702-47cf7a584537 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:07.349539 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6e98ee89-07f6-4de3-a702-47cf7a584537 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:07.350311 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6e98ee89-07f6-4de3-a702-47cf7a584537 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:07.351009 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6e98ee89-07f6-4de3-a702-47cf7a584537 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:07.352040 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6e98ee89-07f6-4de3-a702-47cf7a584537 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:07.568836 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-6e98ee89-07f6-4de3-a702-47cf7a584537 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:50:07.579054 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-6e98ee89-07f6-4de3-a702-47cf7a584537 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/64ac4c3a-dc23-44e3-a2aa-89a6922a9279" status: 200 len: 1265 microversion: 2.1 time: 0.243941 Nov 02 14:50:07.579963 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 504/980] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:50:07 2022] GET /compute/v2.1/servers/64ac4c3a-dc23-44e3-a2aa-89a6922a9279 => generated 1265 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:50:07.902145 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-6e327562-62ec-498b-af87-74192dd5200f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Action: 'create', calling method: .version_select at 0x7fb24ec0ea60>, body: {"keypair": {"name": "tempest-keypair-249575961", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAur6yqH+Mk1d+L1GVpwq2evDSwDwdViWgyI77FF+6R/MnwZAh8JrNwgvLLh9Gesb9X8M9m8XmkPg0YNyzmHE51sM5tGXiZtReeeq8uy1fjp1R1qqObvJqmKvQH5uDah1A=="}} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:50:07.922216 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.quota [None req-6e327562-62ec-498b-af87-74192dd5200f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Getting quotas for project e428f318654f446db48445e4570ae2d3. Resources: {'key_pairs'} {{(pid=119658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:50:07.927376 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.quota [None req-6e327562-62ec-498b-af87-74192dd5200f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Getting quotas for user 7fa761a568644a9399d825498a51f054 and project e428f318654f446db48445e4570ae2d3. Resources: {'key_pairs'} {{(pid=119658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:50:08.015859 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-6e327562-62ec-498b-af87-74192dd5200f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.118565 Nov 02 14:50:08.016399 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 477/981] 10.222.0.30 () {60 vars in 1159 bytes} [Wed Nov 2 14:50:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:50:08.604402 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-4bca67bb-a967-4b41-81cf-ea1554c5232e tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:50:08.606915 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-4bca67bb-a967-4b41-81cf-ea1554c5232e tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: 64ac4c3a-dc23-44e3-a2aa-89a6922a9279] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:50:08.617568 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4bca67bb-a967-4b41-81cf-ea1554c5232e tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:08.618139 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4bca67bb-a967-4b41-81cf-ea1554c5232e tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:08.618872 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4bca67bb-a967-4b41-81cf-ea1554c5232e tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:08.619972 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4bca67bb-a967-4b41-81cf-ea1554c5232e tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:08.620641 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4bca67bb-a967-4b41-81cf-ea1554c5232e tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:08.622055 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4bca67bb-a967-4b41-81cf-ea1554c5232e tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:08.651780 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:50:09.128368 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-4bca67bb-a967-4b41-81cf-ea1554c5232e tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:50:09.167473 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-4bca67bb-a967-4b41-81cf-ea1554c5232e tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/64ac4c3a-dc23-44e3-a2aa-89a6922a9279" status: 200 len: 1265 microversion: 2.1 time: 0.561163 Nov 02 14:50:09.178277 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 505/982] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:50:08 2022] GET /compute/v2.1/servers/64ac4c3a-dc23-44e3-a2aa-89a6922a9279 => generated 1265 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:50:09.210207 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [req-d7aa21ff-b40c-45c7-8a68-945a56d0e5a1 req-b5a7da5d-018c-4eac-b4a7-9611f39b993d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64ac4c3a-dc23-44e3-a2aa-89a6922a9279", "name": "network-vif-plugged", "status": "completed", "tag": "8611187e-9072-476d-847c-6718440138c0"}]} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:50:09.223729 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-d7aa21ff-b40c-45c7-8a68-945a56d0e5a1 req-b5a7da5d-018c-4eac-b4a7-9611f39b993d service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:09.229319 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-d7aa21ff-b40c-45c7-8a68-945a56d0e5a1 req-b5a7da5d-018c-4eac-b4a7-9611f39b993d service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:09.229319 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-d7aa21ff-b40c-45c7-8a68-945a56d0e5a1 req-b5a7da5d-018c-4eac-b4a7-9611f39b993d service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:09.236859 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.compute.server_external_events [req-d7aa21ff-b40c-45c7-8a68-945a56d0e5a1 req-b5a7da5d-018c-4eac-b4a7-9611f39b993d service nova] Creating event network-vif-plugged:8611187e-9072-476d-847c-6718440138c0 for instance 64ac4c3a-dc23-44e3-a2aa-89a6922a9279 on hv-cinder-86236 Nov 02 14:50:09.241745 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [req-d7aa21ff-b40c-45c7-8a68-945a56d0e5a1 req-b5a7da5d-018c-4eac-b4a7-9611f39b993d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039849 Nov 02 14:50:09.242349 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 478/983] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:50:10.203651 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-98187dee-f9e1-4454-bbb6-aceab8accb0e tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:50:10.204707 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-98187dee-f9e1-4454-bbb6-aceab8accb0e tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: 64ac4c3a-dc23-44e3-a2aa-89a6922a9279] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:50:10.213746 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-98187dee-f9e1-4454-bbb6-aceab8accb0e tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:10.214490 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-98187dee-f9e1-4454-bbb6-aceab8accb0e tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:10.215160 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-98187dee-f9e1-4454-bbb6-aceab8accb0e tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:10.216000 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-98187dee-f9e1-4454-bbb6-aceab8accb0e tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:10.216666 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-98187dee-f9e1-4454-bbb6-aceab8accb0e tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:10.217425 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-98187dee-f9e1-4454-bbb6-aceab8accb0e tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:10.411233 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-98187dee-f9e1-4454-bbb6-aceab8accb0e tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:50:10.422331 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-98187dee-f9e1-4454-bbb6-aceab8accb0e tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/64ac4c3a-dc23-44e3-a2aa-89a6922a9279" status: 200 len: 1265 microversion: 2.1 time: 0.223740 Nov 02 14:50:10.423292 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 506/984] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:50:10 2022] GET /compute/v2.1/servers/64ac4c3a-dc23-44e3-a2aa-89a6922a9279 => generated 1265 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:50:10.923095 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-f227b8e8-b1b6-46fc-a009-80043e9494e0 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-369667021", "imageRef": "a726a246-cc7f-46e6-aeff-4d62e03cc091", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d6bf9a07-46e7-4c2d-8535-e65644e316a0"}], "security_groups": [{"name": "tempest-securitygroup--1360538645"}], "key_name": "tempest-keypair-249575961", "user_data": "}} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:50:11.076724 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.network.neutron [None req-f227b8e8-b1b6-46fc-a009-80043e9494e0 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] validate_networks() for [('d6bf9a07-46e7-4c2d-8535-e65644e316a0', None, None, None, None, None)] {{(pid=119658) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:50:11.460705 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-3ca4dba6-84e6-4096-90ea-a4f4669bcde9 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:50:11.462175 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-3ca4dba6-84e6-4096-90ea-a4f4669bcde9 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: 64ac4c3a-dc23-44e3-a2aa-89a6922a9279] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:50:11.472106 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3ca4dba6-84e6-4096-90ea-a4f4669bcde9 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:11.473394 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3ca4dba6-84e6-4096-90ea-a4f4669bcde9 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:11.474035 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3ca4dba6-84e6-4096-90ea-a4f4669bcde9 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:11.475444 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3ca4dba6-84e6-4096-90ea-a4f4669bcde9 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:11.476175 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3ca4dba6-84e6-4096-90ea-a4f4669bcde9 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:11.476801 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3ca4dba6-84e6-4096-90ea-a4f4669bcde9 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:11.725728 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-f227b8e8-b1b6-46fc-a009-80043e9494e0 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Flavor limits 0:0:0 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:50:11.731853 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-3ca4dba6-84e6-4096-90ea-a4f4669bcde9 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:50:11.735944 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-f227b8e8-b1b6-46fc-a009-80043e9494e0 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Image limits 0:0:0 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:50:11.735944 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-f227b8e8-b1b6-46fc-a009-80043e9494e0 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Flavor pref 0:0:0 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:50:11.735944 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-f227b8e8-b1b6-46fc-a009-80043e9494e0 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Image pref 0:0:0 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:50:11.736577 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-f227b8e8-b1b6-46fc-a009-80043e9494e0 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:50:11.744913 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-3ca4dba6-84e6-4096-90ea-a4f4669bcde9 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/64ac4c3a-dc23-44e3-a2aa-89a6922a9279" status: 200 len: 1453 microversion: 2.1 time: 0.288638 Nov 02 14:50:11.747452 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f227b8e8-b1b6-46fc-a009-80043e9494e0 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:11.747721 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 507/985] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:50:11 2022] GET /compute/v2.1/servers/64ac4c3a-dc23-44e3-a2aa-89a6922a9279 => generated 1453 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:50:11.748173 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f227b8e8-b1b6-46fc-a009-80043e9494e0 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:11.748708 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f227b8e8-b1b6-46fc-a009-80043e9494e0 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:11.749631 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f227b8e8-b1b6-46fc-a009-80043e9494e0 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:11.750148 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f227b8e8-b1b6-46fc-a009-80043e9494e0 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:11.750654 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f227b8e8-b1b6-46fc-a009-80043e9494e0 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:11.771025 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.quota [None req-f227b8e8-b1b6-46fc-a009-80043e9494e0 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Getting quotas for project e428f318654f446db48445e4570ae2d3. Resources: {'instances', 'ram', 'cores'} {{(pid=119658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:50:11.776394 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.quota [None req-f227b8e8-b1b6-46fc-a009-80043e9494e0 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Getting quotas for user 7fa761a568644a9399d825498a51f054 and project e428f318654f446db48445e4570ae2d3. Resources: {'instances', 'ram', 'cores'} {{(pid=119658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:50:11.787257 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-7cdfb777-82aa-47a9-9c3d-013a8a6eef30 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:50:11.788350 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-7cdfb777-82aa-47a9-9c3d-013a8a6eef30 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: 64ac4c3a-dc23-44e3-a2aa-89a6922a9279] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:50:11.792784 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-f227b8e8-b1b6-46fc-a009-80043e9494e0 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Going to run 1 instances... {{(pid=119658) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:50:11.795644 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-f227b8e8-b1b6-46fc-a009-80043e9494e0 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: efac2958-b39d-4ad0-9356-42557ec6bab7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a726a246-cc7f-46e6-aeff-4d62e03cc091',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119658) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:50:11.799178 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7cdfb777-82aa-47a9-9c3d-013a8a6eef30 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:11.800028 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7cdfb777-82aa-47a9-9c3d-013a8a6eef30 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:11.800841 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7cdfb777-82aa-47a9-9c3d-013a8a6eef30 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:11.802039 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7cdfb777-82aa-47a9-9c3d-013a8a6eef30 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:11.802857 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7cdfb777-82aa-47a9-9c3d-013a8a6eef30 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:11.803633 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7cdfb777-82aa-47a9-9c3d-013a8a6eef30 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:11.932715 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-f227b8e8-b1b6-46fc-a009-80043e9494e0 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.020206 Nov 02 14:50:11.935473 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 479/986] 10.222.0.30 () {60 vars in 1147 bytes} [Wed Nov 2 14:50:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 1024 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:50:11.963346 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-d201257c-c85e-4248-bcdc-bb7cb6fffd23 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:50:11.964315 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-d201257c-c85e-4248-bcdc-bb7cb6fffd23 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: efac2958-b39d-4ad0-9356-42557ec6bab7] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:50:12.014512 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-7cdfb777-82aa-47a9-9c3d-013a8a6eef30 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:50:12.038891 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-7cdfb777-82aa-47a9-9c3d-013a8a6eef30 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/64ac4c3a-dc23-44e3-a2aa-89a6922a9279" status: 200 len: 1453 microversion: 2.1 time: 0.257900 Nov 02 14:50:12.041477 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 508/987] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:50:11 2022] GET /compute/v2.1/servers/64ac4c3a-dc23-44e3-a2aa-89a6922a9279 => generated 1453 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:50:12.100249 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-d201257c-c85e-4248-bcdc-bb7cb6fffd23 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:50:12.119362 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-d201257c-c85e-4248-bcdc-bb7cb6fffd23 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/efac2958-b39d-4ad0-9356-42557ec6bab7" status: 200 len: 1240 microversion: 2.1 time: 0.160287 Nov 02 14:50:12.120427 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 480/988] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:50:11 2022] GET /compute/v2.1/servers/efac2958-b39d-4ad0-9356-42557ec6bab7 => generated 1240 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:50:13.144876 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-7e9e426b-f5f7-463a-803a-af425e3b9e7a tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:50:13.145929 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-7e9e426b-f5f7-463a-803a-af425e3b9e7a tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: efac2958-b39d-4ad0-9356-42557ec6bab7] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:50:13.241677 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-7e9e426b-f5f7-463a-803a-af425e3b9e7a tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:50:13.255469 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-7e9e426b-f5f7-463a-803a-af425e3b9e7a tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/efac2958-b39d-4ad0-9356-42557ec6bab7" status: 200 len: 1240 microversion: 2.1 time: 0.114616 Nov 02 14:50:13.273906 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 509/989] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:50:13 2022] GET /compute/v2.1/servers/efac2958-b39d-4ad0-9356-42557ec6bab7 => generated 1240 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:50:14.296061 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-1c274eb5-0399-40a1-808f-1ec46aea1d7f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:50:14.297403 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-1c274eb5-0399-40a1-808f-1ec46aea1d7f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: efac2958-b39d-4ad0-9356-42557ec6bab7] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:50:14.316125 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1c274eb5-0399-40a1-808f-1ec46aea1d7f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:14.319032 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1c274eb5-0399-40a1-808f-1ec46aea1d7f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:14.319032 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1c274eb5-0399-40a1-808f-1ec46aea1d7f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:14.319032 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1c274eb5-0399-40a1-808f-1ec46aea1d7f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:14.319032 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1c274eb5-0399-40a1-808f-1ec46aea1d7f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:14.319649 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1c274eb5-0399-40a1-808f-1ec46aea1d7f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:14.321952 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:50:14.444639 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-1c274eb5-0399-40a1-808f-1ec46aea1d7f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:50:14.454502 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-1c274eb5-0399-40a1-808f-1ec46aea1d7f tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/efac2958-b39d-4ad0-9356-42557ec6bab7" status: 200 len: 1292 microversion: 2.1 time: 0.163346 Nov 02 14:50:14.455703 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 481/990] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:50:14 2022] GET /compute/v2.1/servers/efac2958-b39d-4ad0-9356-42557ec6bab7 => generated 1292 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:50:14.972033 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [req-57b3904b-bdd4-4726-a321-ad2770ad006e req-e2e7b3b3-9a1f-4ea6-a599-c6801112b636 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64ac4c3a-dc23-44e3-a2aa-89a6922a9279", "tag": "8611187e-9072-476d-847c-6718440138c0"}]} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:50:14.995309 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-57b3904b-bdd4-4726-a321-ad2770ad006e req-e2e7b3b3-9a1f-4ea6-a599-c6801112b636 service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:14.997171 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-57b3904b-bdd4-4726-a321-ad2770ad006e req-e2e7b3b3-9a1f-4ea6-a599-c6801112b636 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:14.997907 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-57b3904b-bdd4-4726-a321-ad2770ad006e req-e2e7b3b3-9a1f-4ea6-a599-c6801112b636 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:15.011071 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.compute.server_external_events [req-57b3904b-bdd4-4726-a321-ad2770ad006e req-e2e7b3b3-9a1f-4ea6-a599-c6801112b636 service nova] Creating event network-changed:8611187e-9072-476d-847c-6718440138c0 for instance 64ac4c3a-dc23-44e3-a2aa-89a6922a9279 on hv-cinder-86236 Nov 02 14:50:15.018723 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [req-57b3904b-bdd4-4726-a321-ad2770ad006e req-e2e7b3b3-9a1f-4ea6-a599-c6801112b636 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.268978 Nov 02 14:50:15.019729 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 510/991] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:50:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:50:15.486607 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-475f433a-423e-4c46-8935-ed555d6a676e tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:50:15.490766 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-475f433a-423e-4c46-8935-ed555d6a676e tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: efac2958-b39d-4ad0-9356-42557ec6bab7] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:50:15.506003 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-475f433a-423e-4c46-8935-ed555d6a676e tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:15.506599 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-475f433a-423e-4c46-8935-ed555d6a676e tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:15.507111 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-475f433a-423e-4c46-8935-ed555d6a676e tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:15.509196 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-475f433a-423e-4c46-8935-ed555d6a676e tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:15.509805 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-475f433a-423e-4c46-8935-ed555d6a676e tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:15.510317 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-475f433a-423e-4c46-8935-ed555d6a676e tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:15.672514 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-475f433a-423e-4c46-8935-ed555d6a676e tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:50:15.694483 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-475f433a-423e-4c46-8935-ed555d6a676e tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/efac2958-b39d-4ad0-9356-42557ec6bab7" status: 200 len: 1298 microversion: 2.1 time: 0.218500 Nov 02 14:50:15.695077 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 482/992] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:50:15 2022] GET /compute/v2.1/servers/efac2958-b39d-4ad0-9356-42557ec6bab7 => generated 1298 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:50:16.734872 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-83d009d2-1d42-4ee3-9581-0d9d5cb821a4 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:50:16.735679 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-83d009d2-1d42-4ee3-9581-0d9d5cb821a4 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: efac2958-b39d-4ad0-9356-42557ec6bab7] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:50:16.742864 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-83d009d2-1d42-4ee3-9581-0d9d5cb821a4 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:16.743729 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-83d009d2-1d42-4ee3-9581-0d9d5cb821a4 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:16.744545 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-83d009d2-1d42-4ee3-9581-0d9d5cb821a4 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:16.745755 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-83d009d2-1d42-4ee3-9581-0d9d5cb821a4 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:16.746185 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-83d009d2-1d42-4ee3-9581-0d9d5cb821a4 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:16.746816 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-83d009d2-1d42-4ee3-9581-0d9d5cb821a4 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:17.012748 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-83d009d2-1d42-4ee3-9581-0d9d5cb821a4 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:50:17.023234 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-83d009d2-1d42-4ee3-9581-0d9d5cb821a4 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/efac2958-b39d-4ad0-9356-42557ec6bab7" status: 200 len: 1366 microversion: 2.1 time: 0.294025 Nov 02 14:50:17.024110 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 511/993] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:50:16 2022] GET /compute/v2.1/servers/efac2958-b39d-4ad0-9356-42557ec6bab7 => generated 1366 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:50:17.340375 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [req-d0637b26-6113-4013-bde8-c8aa29e7e075 req-50df12cb-abf6-4e61-9e7c-17bb6f49b3a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efac2958-b39d-4ad0-9356-42557ec6bab7", "tag": "010eaa1b-4e57-4825-aa1e-d4db853b5969"}]} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:50:17.356044 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-d0637b26-6113-4013-bde8-c8aa29e7e075 req-50df12cb-abf6-4e61-9e7c-17bb6f49b3a2 service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:17.356865 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-d0637b26-6113-4013-bde8-c8aa29e7e075 req-50df12cb-abf6-4e61-9e7c-17bb6f49b3a2 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:17.358074 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-d0637b26-6113-4013-bde8-c8aa29e7e075 req-50df12cb-abf6-4e61-9e7c-17bb6f49b3a2 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:17.374882 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.compute.server_external_events [req-d0637b26-6113-4013-bde8-c8aa29e7e075 req-50df12cb-abf6-4e61-9e7c-17bb6f49b3a2 service nova] Creating event network-changed:010eaa1b-4e57-4825-aa1e-d4db853b5969 for instance efac2958-b39d-4ad0-9356-42557ec6bab7 on hv-cinder-86236 Nov 02 14:50:17.382601 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [req-d0637b26-6113-4013-bde8-c8aa29e7e075 req-50df12cb-abf6-4e61-9e7c-17bb6f49b3a2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048471 Nov 02 14:50:17.383670 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 483/994] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:50:18.050877 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-960bc1bb-9c6c-44d2-b954-7281fa01892e tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:50:18.052291 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-960bc1bb-9c6c-44d2-b954-7281fa01892e tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: efac2958-b39d-4ad0-9356-42557ec6bab7] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:50:18.064653 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-960bc1bb-9c6c-44d2-b954-7281fa01892e tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:18.065576 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-960bc1bb-9c6c-44d2-b954-7281fa01892e tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:18.066205 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-960bc1bb-9c6c-44d2-b954-7281fa01892e tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:18.067537 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-960bc1bb-9c6c-44d2-b954-7281fa01892e tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:18.067977 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-960bc1bb-9c6c-44d2-b954-7281fa01892e tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:18.068508 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-960bc1bb-9c6c-44d2-b954-7281fa01892e tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:18.597659 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-960bc1bb-9c6c-44d2-b954-7281fa01892e tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:50:18.617992 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-960bc1bb-9c6c-44d2-b954-7281fa01892e tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/efac2958-b39d-4ad0-9356-42557ec6bab7" status: 200 len: 1366 microversion: 2.1 time: 0.571893 Nov 02 14:50:18.619348 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 512/995] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:50:18 2022] GET /compute/v2.1/servers/efac2958-b39d-4ad0-9356-42557ec6bab7 => generated 1366 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:50:19.655662 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-8f89d350-07ab-490c-a096-2abe56c482bf tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:50:19.656500 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-8f89d350-07ab-490c-a096-2abe56c482bf tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: efac2958-b39d-4ad0-9356-42557ec6bab7] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:50:19.658667 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:50:19.664148 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8f89d350-07ab-490c-a096-2abe56c482bf tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:19.664643 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8f89d350-07ab-490c-a096-2abe56c482bf tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:19.665130 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8f89d350-07ab-490c-a096-2abe56c482bf tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:19.665861 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8f89d350-07ab-490c-a096-2abe56c482bf tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:19.666323 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8f89d350-07ab-490c-a096-2abe56c482bf tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:19.666761 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8f89d350-07ab-490c-a096-2abe56c482bf tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:19.848315 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-8f89d350-07ab-490c-a096-2abe56c482bf tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:50:19.858888 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-8f89d350-07ab-490c-a096-2abe56c482bf tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/efac2958-b39d-4ad0-9356-42557ec6bab7" status: 200 len: 1366 microversion: 2.1 time: 0.208834 Nov 02 14:50:19.859741 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 484/996] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:50:19 2022] GET /compute/v2.1/servers/efac2958-b39d-4ad0-9356-42557ec6bab7 => generated 1366 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:50:20.886607 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-5050e68a-ef15-450c-9fb7-9c8cbc3d96e2 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:50:20.887539 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-5050e68a-ef15-450c-9fb7-9c8cbc3d96e2 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: efac2958-b39d-4ad0-9356-42557ec6bab7] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:50:20.889996 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:50:20.895254 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5050e68a-ef15-450c-9fb7-9c8cbc3d96e2 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:20.895752 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5050e68a-ef15-450c-9fb7-9c8cbc3d96e2 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:20.898651 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5050e68a-ef15-450c-9fb7-9c8cbc3d96e2 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:20.898651 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5050e68a-ef15-450c-9fb7-9c8cbc3d96e2 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:20.898651 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5050e68a-ef15-450c-9fb7-9c8cbc3d96e2 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:20.898651 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5050e68a-ef15-450c-9fb7-9c8cbc3d96e2 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:21.114539 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-5050e68a-ef15-450c-9fb7-9c8cbc3d96e2 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:50:21.132416 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-5050e68a-ef15-450c-9fb7-9c8cbc3d96e2 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/efac2958-b39d-4ad0-9356-42557ec6bab7" status: 200 len: 1366 microversion: 2.1 time: 0.249646 Nov 02 14:50:21.134130 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 513/997] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:50:20 2022] GET /compute/v2.1/servers/efac2958-b39d-4ad0-9356-42557ec6bab7 => generated 1366 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:50:22.169094 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-f53128a0-d574-41ee-b268-8c74ff20e9c0 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:50:22.170072 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-f53128a0-d574-41ee-b268-8c74ff20e9c0 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: efac2958-b39d-4ad0-9356-42557ec6bab7] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:50:22.172860 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell0:SELECT=2 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:50:22.173925 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell0:SELECT=12 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:50:22.180745 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f53128a0-d574-41ee-b268-8c74ff20e9c0 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:22.180745 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f53128a0-d574-41ee-b268-8c74ff20e9c0 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:22.183843 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f53128a0-d574-41ee-b268-8c74ff20e9c0 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:22.185118 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f53128a0-d574-41ee-b268-8c74ff20e9c0 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:22.186020 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f53128a0-d574-41ee-b268-8c74ff20e9c0 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:22.186750 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f53128a0-d574-41ee-b268-8c74ff20e9c0 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:22.363864 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-f53128a0-d574-41ee-b268-8c74ff20e9c0 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:50:22.375079 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-f53128a0-d574-41ee-b268-8c74ff20e9c0 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/efac2958-b39d-4ad0-9356-42557ec6bab7" status: 200 len: 1366 microversion: 2.1 time: 0.210751 Nov 02 14:50:22.375677 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 485/998] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:50:22 2022] GET /compute/v2.1/servers/efac2958-b39d-4ad0-9356-42557ec6bab7 => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:50:23.249428 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell0:SELECT=2 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:50:23.352448 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [req-45dbbaff-f361-49eb-a756-f7ffc21ceb5d req-9d9736fd-eb5f-44d7-9d2a-a08c088fa709 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efac2958-b39d-4ad0-9356-42557ec6bab7", "name": "network-vif-plugged", "status": "completed", "tag": "010eaa1b-4e57-4825-aa1e-d4db853b5969"}]} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:50:23.364508 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-45dbbaff-f361-49eb-a756-f7ffc21ceb5d req-9d9736fd-eb5f-44d7-9d2a-a08c088fa709 service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:23.364993 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-45dbbaff-f361-49eb-a756-f7ffc21ceb5d req-9d9736fd-eb5f-44d7-9d2a-a08c088fa709 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:23.365537 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-45dbbaff-f361-49eb-a756-f7ffc21ceb5d req-9d9736fd-eb5f-44d7-9d2a-a08c088fa709 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:23.378691 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.compute.server_external_events [req-45dbbaff-f361-49eb-a756-f7ffc21ceb5d req-9d9736fd-eb5f-44d7-9d2a-a08c088fa709 service nova] Creating event network-vif-plugged:010eaa1b-4e57-4825-aa1e-d4db853b5969 for instance efac2958-b39d-4ad0-9356-42557ec6bab7 on hv-cinder-86236 Nov 02 14:50:23.384359 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [req-45dbbaff-f361-49eb-a756-f7ffc21ceb5d req-9d9736fd-eb5f-44d7-9d2a-a08c088fa709 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.186072 Nov 02 14:50:23.385337 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 514/999] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:50:23.418721 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-97be0053-c4f8-48c0-8222-c233f78c15f5 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:50:23.419969 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-97be0053-c4f8-48c0-8222-c233f78c15f5 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: efac2958-b39d-4ad0-9356-42557ec6bab7] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:50:23.431148 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-97be0053-c4f8-48c0-8222-c233f78c15f5 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:23.431934 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-97be0053-c4f8-48c0-8222-c233f78c15f5 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:23.432657 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-97be0053-c4f8-48c0-8222-c233f78c15f5 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:23.433877 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-97be0053-c4f8-48c0-8222-c233f78c15f5 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:23.434521 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-97be0053-c4f8-48c0-8222-c233f78c15f5 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:23.435000 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-97be0053-c4f8-48c0-8222-c233f78c15f5 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:23.594397 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-97be0053-c4f8-48c0-8222-c233f78c15f5 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:50:23.603255 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-97be0053-c4f8-48c0-8222-c233f78c15f5 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/efac2958-b39d-4ad0-9356-42557ec6bab7" status: 200 len: 1366 microversion: 2.1 time: 0.192124 Nov 02 14:50:23.603748 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 486/1000] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:50:23 2022] GET /compute/v2.1/servers/efac2958-b39d-4ad0-9356-42557ec6bab7 => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:50:24.634518 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-06355329-854f-4cd1-bea9-91b4e5de94b1 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:50:24.635225 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-06355329-854f-4cd1-bea9-91b4e5de94b1 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: efac2958-b39d-4ad0-9356-42557ec6bab7] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:50:24.642688 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-06355329-854f-4cd1-bea9-91b4e5de94b1 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:24.643178 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-06355329-854f-4cd1-bea9-91b4e5de94b1 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:24.643618 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-06355329-854f-4cd1-bea9-91b4e5de94b1 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:24.644332 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-06355329-854f-4cd1-bea9-91b4e5de94b1 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:24.644786 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-06355329-854f-4cd1-bea9-91b4e5de94b1 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:24.645246 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-06355329-854f-4cd1-bea9-91b4e5de94b1 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:24.806442 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-06355329-854f-4cd1-bea9-91b4e5de94b1 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:50:24.821394 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-06355329-854f-4cd1-bea9-91b4e5de94b1 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/efac2958-b39d-4ad0-9356-42557ec6bab7" status: 200 len: 1366 microversion: 2.1 time: 0.192122 Nov 02 14:50:24.822417 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 515/1001] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:50:24 2022] GET /compute/v2.1/servers/efac2958-b39d-4ad0-9356-42557ec6bab7 => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:50:25.857682 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-8922341a-8441-4490-b2e3-1f8d38fe97b0 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:50:25.858530 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-8922341a-8441-4490-b2e3-1f8d38fe97b0 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: efac2958-b39d-4ad0-9356-42557ec6bab7] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:50:25.866151 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8922341a-8441-4490-b2e3-1f8d38fe97b0 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:25.866661 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8922341a-8441-4490-b2e3-1f8d38fe97b0 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:25.867104 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8922341a-8441-4490-b2e3-1f8d38fe97b0 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:25.867857 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8922341a-8441-4490-b2e3-1f8d38fe97b0 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:25.868323 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8922341a-8441-4490-b2e3-1f8d38fe97b0 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:25.869047 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8922341a-8441-4490-b2e3-1f8d38fe97b0 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:26.033217 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-8922341a-8441-4490-b2e3-1f8d38fe97b0 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:50:26.048030 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-8922341a-8441-4490-b2e3-1f8d38fe97b0 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/efac2958-b39d-4ad0-9356-42557ec6bab7" status: 200 len: 1556 microversion: 2.1 time: 0.194803 Nov 02 14:50:26.049148 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 487/1002] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:50:25 2022] GET /compute/v2.1/servers/efac2958-b39d-4ad0-9356-42557ec6bab7 => generated 1556 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:50:26.072139 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-89c33fa8-ca4b-477c-8691-8d380fe3acfe tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:50:26.072757 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-89c33fa8-ca4b-477c-8691-8d380fe3acfe tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: efac2958-b39d-4ad0-9356-42557ec6bab7] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:50:26.079636 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-89c33fa8-ca4b-477c-8691-8d380fe3acfe tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:26.080142 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-89c33fa8-ca4b-477c-8691-8d380fe3acfe tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:26.080574 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-89c33fa8-ca4b-477c-8691-8d380fe3acfe tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:26.087029 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-89c33fa8-ca4b-477c-8691-8d380fe3acfe tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:26.087029 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-89c33fa8-ca4b-477c-8691-8d380fe3acfe tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:26.087029 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-89c33fa8-ca4b-477c-8691-8d380fe3acfe tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:26.172800 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-89c33fa8-ca4b-477c-8691-8d380fe3acfe tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/efac2958-b39d-4ad0-9356-42557ec6bab7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.104612 Nov 02 14:50:26.173490 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 516/1003] 10.222.0.30 () {58 vars in 1275 bytes} [Wed Nov 2 14:50:26 2022] GET /compute/v2.1/servers/efac2958-b39d-4ad0-9356-42557ec6bab7/os-interface => generated 285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:50:27.426836 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [req-5516f0a0-8e86-4cdf-8a9a-dbf1c6e5b4c5 req-f924bc0b-148d-4c63-9fc8-8e266b3fd090 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efac2958-b39d-4ad0-9356-42557ec6bab7", "tag": "010eaa1b-4e57-4825-aa1e-d4db853b5969"}]} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:50:27.437296 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-5516f0a0-8e86-4cdf-8a9a-dbf1c6e5b4c5 req-f924bc0b-148d-4c63-9fc8-8e266b3fd090 service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:27.437782 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-5516f0a0-8e86-4cdf-8a9a-dbf1c6e5b4c5 req-f924bc0b-148d-4c63-9fc8-8e266b3fd090 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:27.438224 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-5516f0a0-8e86-4cdf-8a9a-dbf1c6e5b4c5 req-f924bc0b-148d-4c63-9fc8-8e266b3fd090 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:27.451915 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.compute.server_external_events [req-5516f0a0-8e86-4cdf-8a9a-dbf1c6e5b4c5 req-f924bc0b-148d-4c63-9fc8-8e266b3fd090 service nova] Creating event network-changed:010eaa1b-4e57-4825-aa1e-d4db853b5969 for instance efac2958-b39d-4ad0-9356-42557ec6bab7 on hv-cinder-86236 Nov 02 14:50:27.457726 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [req-5516f0a0-8e86-4cdf-8a9a-dbf1c6e5b4c5 req-f924bc0b-148d-4c63-9fc8-8e266b3fd090 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034228 Nov 02 14:50:27.458701 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 488/1004] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:51:03.781123 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_api:SELECT=7 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:51:03.781884 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell1:SELECT=54 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:51:03.785887 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-2e96b687-21b8-4325-a00a-00ef62349ffa tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:51:03.786425 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-2e96b687-21b8-4325-a00a-00ef62349ffa tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: efac2958-b39d-4ad0-9356-42557ec6bab7] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:51:03.792610 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2e96b687-21b8-4325-a00a-00ef62349ffa tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:03.806045 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2e96b687-21b8-4325-a00a-00ef62349ffa tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:03.806045 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2e96b687-21b8-4325-a00a-00ef62349ffa tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:03.806045 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2e96b687-21b8-4325-a00a-00ef62349ffa tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:03.806045 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2e96b687-21b8-4325-a00a-00ef62349ffa tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:03.807111 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2e96b687-21b8-4325-a00a-00ef62349ffa tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:03.819573 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-2e96b687-21b8-4325-a00a-00ef62349ffa tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/efac2958-b39d-4ad0-9356-42557ec6bab7/ips" status: 200 len: 150 microversion: 2.1 time: 0.039958 Nov 02 14:51:03.820153 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 517/1005] 10.222.0.30 () {58 vars in 1248 bytes} [Wed Nov 2 14:51:03 2022] GET /compute/v2.1/servers/efac2958-b39d-4ad0-9356-42557ec6bab7/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:51:05.418931 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-aa3a12fa-bf0d-4b5b-9c55-e58cc7749540 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4ef22196-abff-4d79-a524-2c62875094b2"}} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:51:05.421408 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-aa3a12fa-bf0d-4b5b-9c55-e58cc7749540 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: efac2958-b39d-4ad0-9356-42557ec6bab7] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:51:05.423948 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_api:SELECT=9 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:51:05.424605 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell1:SELECT=39 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:51:05.430206 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-aa3a12fa-bf0d-4b5b-9c55-e58cc7749540 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:05.430700 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-aa3a12fa-bf0d-4b5b-9c55-e58cc7749540 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:05.431138 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-aa3a12fa-bf0d-4b5b-9c55-e58cc7749540 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:05.432681 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-aa3a12fa-bf0d-4b5b-9c55-e58cc7749540 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:05.433166 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-aa3a12fa-bf0d-4b5b-9c55-e58cc7749540 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:05.433597 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-aa3a12fa-bf0d-4b5b-9c55-e58cc7749540 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:06.169317 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-aa3a12fa-bf0d-4b5b-9c55-e58cc7749540 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "POST /compute/v2.1/servers/efac2958-b39d-4ad0-9356-42557ec6bab7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.755462 Nov 02 14:51:06.170011 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 489/1006] 10.222.0.30 () {60 vars in 1323 bytes} [Wed Nov 2 14:51:05 2022] POST /compute/v2.1/servers/efac2958-b39d-4ad0-9356-42557ec6bab7/os-volume_attachments => generated 194 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:51:13.817132 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-27e8da1e-93c2-45ad-8285-a0bea4320f3c tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:51:13.817748 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-27e8da1e-93c2-45ad-8285-a0bea4320f3c tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: efac2958-b39d-4ad0-9356-42557ec6bab7] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:51:13.825808 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-27e8da1e-93c2-45ad-8285-a0bea4320f3c tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:13.826285 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-27e8da1e-93c2-45ad-8285-a0bea4320f3c tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:13.826717 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-27e8da1e-93c2-45ad-8285-a0bea4320f3c tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:13.827404 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-27e8da1e-93c2-45ad-8285-a0bea4320f3c tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:13.827853 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-27e8da1e-93c2-45ad-8285-a0bea4320f3c tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:13.828273 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-27e8da1e-93c2-45ad-8285-a0bea4320f3c tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:13.910136 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.objects.instance [None req-27e8da1e-93c2-45ad-8285-a0bea4320f3c tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lazy-loading 'services' on Instance uuid efac2958-b39d-4ad0-9356-42557ec6bab7 {{(pid=119659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:51:14.086186 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-27e8da1e-93c2-45ad-8285-a0bea4320f3c tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "DELETE /compute/v2.1/servers/efac2958-b39d-4ad0-9356-42557ec6bab7/os-volume_attachments/4ef22196-abff-4d79-a524-2c62875094b2" status: 202 len: 0 microversion: 2.1 time: 0.273157 Nov 02 14:51:14.086772 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 518/1007] 10.222.0.30 () {58 vars in 1416 bytes} [Wed Nov 2 14:51:13 2022] DELETE /compute/v2.1/servers/efac2958-b39d-4ad0-9356-42557ec6bab7/os-volume_attachments/4ef22196-abff-4d79-a524-2c62875094b2 => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:51:14.096450 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-3acd0610-f6d1-4e12-9a48-79f2b3555f1c tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:51:14.098949 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-3acd0610-f6d1-4e12-9a48-79f2b3555f1c tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: efac2958-b39d-4ad0-9356-42557ec6bab7] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:51:14.105292 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3acd0610-f6d1-4e12-9a48-79f2b3555f1c tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:14.105786 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3acd0610-f6d1-4e12-9a48-79f2b3555f1c tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:14.106224 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3acd0610-f6d1-4e12-9a48-79f2b3555f1c tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:14.106932 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3acd0610-f6d1-4e12-9a48-79f2b3555f1c tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:14.107389 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3acd0610-f6d1-4e12-9a48-79f2b3555f1c tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:14.107815 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3acd0610-f6d1-4e12-9a48-79f2b3555f1c tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:14.139823 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-3acd0610-f6d1-4e12-9a48-79f2b3555f1c tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/efac2958-b39d-4ad0-9356-42557ec6bab7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048049 Nov 02 14:51:14.140311 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 490/1008] 10.222.0.30 () {58 vars in 1302 bytes} [Wed Nov 2 14:51:14 2022] GET /compute/v2.1/servers/efac2958-b39d-4ad0-9356-42557ec6bab7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:51:15.153663 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-dd34a936-6779-4a7f-b2db-a9ddb9d3b15e tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:51:15.156098 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-dd34a936-6779-4a7f-b2db-a9ddb9d3b15e tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: efac2958-b39d-4ad0-9356-42557ec6bab7] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:51:15.162421 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-dd34a936-6779-4a7f-b2db-a9ddb9d3b15e tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:15.162905 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-dd34a936-6779-4a7f-b2db-a9ddb9d3b15e tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:15.163344 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-dd34a936-6779-4a7f-b2db-a9ddb9d3b15e tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:15.164044 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-dd34a936-6779-4a7f-b2db-a9ddb9d3b15e tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:15.164500 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-dd34a936-6779-4a7f-b2db-a9ddb9d3b15e tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:15.164935 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-dd34a936-6779-4a7f-b2db-a9ddb9d3b15e tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:15.196993 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-dd34a936-6779-4a7f-b2db-a9ddb9d3b15e tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/efac2958-b39d-4ad0-9356-42557ec6bab7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048142 Nov 02 14:51:15.198109 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 519/1009] 10.222.0.30 () {58 vars in 1302 bytes} [Wed Nov 2 14:51:15 2022] GET /compute/v2.1/servers/efac2958-b39d-4ad0-9356-42557ec6bab7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:51:16.209197 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-aca9358a-0275-4e44-bd9b-5d241ffaef23 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:51:16.211342 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-aca9358a-0275-4e44-bd9b-5d241ffaef23 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: efac2958-b39d-4ad0-9356-42557ec6bab7] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:51:16.218515 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-aca9358a-0275-4e44-bd9b-5d241ffaef23 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:16.219028 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-aca9358a-0275-4e44-bd9b-5d241ffaef23 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:16.219449 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-aca9358a-0275-4e44-bd9b-5d241ffaef23 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:16.220143 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-aca9358a-0275-4e44-bd9b-5d241ffaef23 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:16.220596 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-aca9358a-0275-4e44-bd9b-5d241ffaef23 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:16.221042 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-aca9358a-0275-4e44-bd9b-5d241ffaef23 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:16.250818 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-aca9358a-0275-4e44-bd9b-5d241ffaef23 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/efac2958-b39d-4ad0-9356-42557ec6bab7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045599 Nov 02 14:51:16.251384 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 491/1010] 10.222.0.30 () {58 vars in 1302 bytes} [Wed Nov 2 14:51:16 2022] GET /compute/v2.1/servers/efac2958-b39d-4ad0-9356-42557ec6bab7/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 14:51:16.315200 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-18a56e74-544e-45e1-9bdd-60c9360aa0de tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:51:16.315716 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-18a56e74-544e-45e1-9bdd-60c9360aa0de tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: efac2958-b39d-4ad0-9356-42557ec6bab7] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:51:16.322500 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-18a56e74-544e-45e1-9bdd-60c9360aa0de tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:16.322991 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-18a56e74-544e-45e1-9bdd-60c9360aa0de tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:16.323432 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-18a56e74-544e-45e1-9bdd-60c9360aa0de tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:16.324164 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-18a56e74-544e-45e1-9bdd-60c9360aa0de tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:16.324619 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-18a56e74-544e-45e1-9bdd-60c9360aa0de tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:16.325076 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-18a56e74-544e-45e1-9bdd-60c9360aa0de tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:16.350312 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-18a56e74-544e-45e1-9bdd-60c9360aa0de tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: efac2958-b39d-4ad0-9356-42557ec6bab7] Going to try to terminate instance {{(pid=119659) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:51:16.612483 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-18a56e74-544e-45e1-9bdd-60c9360aa0de tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "DELETE /compute/v2.1/servers/efac2958-b39d-4ad0-9356-42557ec6bab7" status: 204 len: 0 microversion: 2.1 time: 0.300853 Nov 02 14:51:16.613096 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 520/1011] 10.222.0.30 () {58 vars in 1239 bytes} [Wed Nov 2 14:51:16 2022] DELETE /compute/v2.1/servers/efac2958-b39d-4ad0-9356-42557ec6bab7 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:51:16.622452 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-4ee7b82a-a159-4756-bbcb-2aee32b37841 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:51:16.623162 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-4ee7b82a-a159-4756-bbcb-2aee32b37841 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: efac2958-b39d-4ad0-9356-42557ec6bab7] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:51:16.629200 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4ee7b82a-a159-4756-bbcb-2aee32b37841 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:16.629692 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4ee7b82a-a159-4756-bbcb-2aee32b37841 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:16.630128 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4ee7b82a-a159-4756-bbcb-2aee32b37841 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:16.630828 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4ee7b82a-a159-4756-bbcb-2aee32b37841 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:16.631283 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4ee7b82a-a159-4756-bbcb-2aee32b37841 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:16.631713 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4ee7b82a-a159-4756-bbcb-2aee32b37841 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:16.765596 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-4ee7b82a-a159-4756-bbcb-2aee32b37841 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:51:16.773818 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-4ee7b82a-a159-4756-bbcb-2aee32b37841 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/efac2958-b39d-4ad0-9356-42557ec6bab7" status: 200 len: 1681 microversion: 2.1 time: 0.156111 Nov 02 14:51:16.774421 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 492/1012] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:51:16 2022] GET /compute/v2.1/servers/efac2958-b39d-4ad0-9356-42557ec6bab7 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:51:17.798335 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-b88425d6-239d-45f2-b3af-824fbac8f098 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:51:17.799022 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-b88425d6-239d-45f2-b3af-824fbac8f098 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: efac2958-b39d-4ad0-9356-42557ec6bab7] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:51:17.805652 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b88425d6-239d-45f2-b3af-824fbac8f098 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:17.806229 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b88425d6-239d-45f2-b3af-824fbac8f098 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:17.806751 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b88425d6-239d-45f2-b3af-824fbac8f098 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:17.807451 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b88425d6-239d-45f2-b3af-824fbac8f098 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:17.807897 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b88425d6-239d-45f2-b3af-824fbac8f098 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:17.808316 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b88425d6-239d-45f2-b3af-824fbac8f098 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:17.947187 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-b88425d6-239d-45f2-b3af-824fbac8f098 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:51:17.955116 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-b88425d6-239d-45f2-b3af-824fbac8f098 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/efac2958-b39d-4ad0-9356-42557ec6bab7" status: 200 len: 1681 microversion: 2.1 time: 0.161034 Nov 02 14:51:17.955693 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 521/1013] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:51:17 2022] GET /compute/v2.1/servers/efac2958-b39d-4ad0-9356-42557ec6bab7 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:51:18.979809 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-08f647d6-21a8-4635-a93e-103f89cc7256 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:51:18.980421 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-08f647d6-21a8-4635-a93e-103f89cc7256 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: efac2958-b39d-4ad0-9356-42557ec6bab7] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:51:18.986873 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-08f647d6-21a8-4635-a93e-103f89cc7256 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:18.987357 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-08f647d6-21a8-4635-a93e-103f89cc7256 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:18.987797 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-08f647d6-21a8-4635-a93e-103f89cc7256 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:18.988493 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-08f647d6-21a8-4635-a93e-103f89cc7256 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:18.988943 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-08f647d6-21a8-4635-a93e-103f89cc7256 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:18.989402 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-08f647d6-21a8-4635-a93e-103f89cc7256 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:19.056270 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-08f647d6-21a8-4635-a93e-103f89cc7256 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:51:19.064453 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-08f647d6-21a8-4635-a93e-103f89cc7256 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/efac2958-b39d-4ad0-9356-42557ec6bab7" status: 200 len: 1613 microversion: 2.1 time: 0.089219 Nov 02 14:51:19.065066 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 493/1014] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:51:18 2022] GET /compute/v2.1/servers/efac2958-b39d-4ad0-9356-42557ec6bab7 => generated 1613 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:51:19.175599 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [req-e24a71ec-c40f-41bb-8c1c-5e4fc9445f83 req-0de02e8f-7e68-4e6e-87d6-2efa3c74ed63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efac2958-b39d-4ad0-9356-42557ec6bab7", "name": "network-vif-deleted", "tag": "010eaa1b-4e57-4825-aa1e-d4db853b5969"}]} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:51:19.187349 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-e24a71ec-c40f-41bb-8c1c-5e4fc9445f83 req-0de02e8f-7e68-4e6e-87d6-2efa3c74ed63 service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:19.194484 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-e24a71ec-c40f-41bb-8c1c-5e4fc9445f83 req-0de02e8f-7e68-4e6e-87d6-2efa3c74ed63 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:19.194484 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-e24a71ec-c40f-41bb-8c1c-5e4fc9445f83 req-0de02e8f-7e68-4e6e-87d6-2efa3c74ed63 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:19.201122 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.compute.server_external_events [req-e24a71ec-c40f-41bb-8c1c-5e4fc9445f83 req-0de02e8f-7e68-4e6e-87d6-2efa3c74ed63 service nova] Creating event network-vif-deleted:010eaa1b-4e57-4825-aa1e-d4db853b5969 for instance efac2958-b39d-4ad0-9356-42557ec6bab7 on hv-cinder-86236 Nov 02 14:51:19.206398 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [req-e24a71ec-c40f-41bb-8c1c-5e4fc9445f83 req-0de02e8f-7e68-4e6e-87d6-2efa3c74ed63 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034485 Nov 02 14:51:19.207364 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 522/1015] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:51:20.089791 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-27695312-462e-49fd-9cbd-1adb8d65e453 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:51:20.090423 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-27695312-462e-49fd-9cbd-1adb8d65e453 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: efac2958-b39d-4ad0-9356-42557ec6bab7] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:51:20.097591 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-27695312-462e-49fd-9cbd-1adb8d65e453 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:20.098182 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-27695312-462e-49fd-9cbd-1adb8d65e453 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:20.098642 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-27695312-462e-49fd-9cbd-1adb8d65e453 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:20.099381 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-27695312-462e-49fd-9cbd-1adb8d65e453 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:20.099847 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-27695312-462e-49fd-9cbd-1adb8d65e453 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:20.100281 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-27695312-462e-49fd-9cbd-1adb8d65e453 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:20.135749 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-27695312-462e-49fd-9cbd-1adb8d65e453 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:20.136243 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-27695312-462e-49fd-9cbd-1adb8d65e453 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:20.136686 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-27695312-462e-49fd-9cbd-1adb8d65e453 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:20.137180 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.objects.instance [None req-27695312-462e-49fd-9cbd-1adb8d65e453 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lazy-loading 'fault' on Instance uuid efac2958-b39d-4ad0-9356-42557ec6bab7 {{(pid=119658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:51:20.183446 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-27695312-462e-49fd-9cbd-1adb8d65e453 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa761a568644a9399d825498a51f054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e428f318654f446db48445e4570ae2d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:51:20.191313 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-27695312-462e-49fd-9cbd-1adb8d65e453 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/efac2958-b39d-4ad0-9356-42557ec6bab7" status: 200 len: 1330 microversion: 2.1 time: 0.106408 Nov 02 14:51:20.191887 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 494/1016] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:51:20 2022] GET /compute/v2.1/servers/efac2958-b39d-4ad0-9356-42557ec6bab7 => generated 1330 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:51:21.216736 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-541029b2-c5ef-4062-9353-729d63a4358c tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:51:21.217458 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-541029b2-c5ef-4062-9353-729d63a4358c tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: efac2958-b39d-4ad0-9356-42557ec6bab7] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:51:21.223681 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-541029b2-c5ef-4062-9353-729d63a4358c tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:21.225238 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-541029b2-c5ef-4062-9353-729d63a4358c tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:21.225238 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-541029b2-c5ef-4062-9353-729d63a4358c tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:21.225443 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-541029b2-c5ef-4062-9353-729d63a4358c tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:21.225735 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-541029b2-c5ef-4062-9353-729d63a4358c tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:21.226158 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-541029b2-c5ef-4062-9353-729d63a4358c tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:21.239722 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.wsgi [None req-541029b2-c5ef-4062-9353-729d63a4358c tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] HTTP exception thrown: Instance efac2958-b39d-4ad0-9356-42557ec6bab7 could not be found. Nov 02 14:51:21.241432 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-541029b2-c5ef-4062-9353-729d63a4358c tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Request method failure captured: Nov 02 14:51:21.241432 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: request: GET /compute/v2.1/servers/efac2958-b39d-4ad0-9356-42557ec6bab7 HTTP/1.1 Nov 02 14:51:21.241432 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Accept: application/json Nov 02 14:51:21.241432 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Accept-Encoding: identity Nov 02 14:51:21.241432 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Connection: close Nov 02 14:51:21.241432 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Content-Length: 0 Nov 02 14:51:21.241432 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Content-Type: application/json Nov 02 14:51:21.241432 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Host: 10.222.0.30 Nov 02 14:51:21.241432 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Openstack-System-Scope: None Nov 02 14:51:21.241432 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: User-Agent: python-urllib3/1.26.12 Nov 02 14:51:21.241432 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Auth-Token: gAAAAABjYoLLvHsLbLP8fTVuFWPOl6OBOImR3Z5sy0YBc5pcdW4rsQGD2999fEEKagme5Rl64Y-6rgjuI819nWAO1ogYJFLnm9s-YT3gxgnSb4U1lYBBYG0Hxitg6Xb3tz5FVnIsGEbww8BWoFWN4RSJnQNLjjxID_ZFkIwIYop5btRshsuXhyM Nov 02 14:51:21.241432 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Domain-Id: None Nov 02 14:51:21.241432 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Domain-Name: None Nov 02 14:51:21.241432 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Identity-Status: Confirmed Nov 02 14:51:21.241432 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Is-Admin-Project: True Nov 02 14:51:21.241432 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Domain-Id: default Nov 02 14:51:21.241432 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Domain-Name: Default Nov 02 14:51:21.241432 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Id: e428f318654f446db48445e4570ae2d3 Nov 02 14:51:21.241432 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Name: tempest-AttachVolumeNegativeTest-1274711238 Nov 02 14:51:21.241432 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Role: reader,member Nov 02 14:51:21.241432 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Roles: reader,member Nov 02 14:51:21.243158 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e428f318654f446db48445e4570ae2d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e428f318654f446db48445e4570ae2d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e428f318654f446db48445e4570ae2d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e428f318654f446db48445e4570ae2d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:51:21.243158 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant: tempest-AttachVolumeNegativeTest-1274711238 Nov 02 14:51:21.243158 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant-Id: e428f318654f446db48445e4570ae2d3 Nov 02 14:51:21.243158 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1274711238 Nov 02 14:51:21.243158 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User: tempest-AttachVolumeNegativeTest-1274711238-project Nov 02 14:51:21.243158 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Domain-Id: default Nov 02 14:51:21.243158 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Domain-Name: Default Nov 02 14:51:21.243158 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Id: 7fa761a568644a9399d825498a51f054 Nov 02 14:51:21.243158 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Name: tempest-AttachVolumeNegativeTest-1274711238-project Nov 02 14:51:21.243158 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: method: > Nov 02 14:51:21.243158 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: exception: Instance efac2958-b39d-4ad0-9356-42557ec6bab7 could not be found. Nov 02 14:51:21.243158 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: action_args: {'id': 'efac2958-b39d-4ad0-9356-42557ec6bab7'} Nov 02 14:51:21.244120 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:51:21.244120 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:51:21.244120 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:51:21.244120 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:51:21.244120 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:51:21.244120 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:51:21.244120 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:51:21.244120 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:51:21.244120 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:51:21.244120 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:51:21.244120 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efac2958-b39d-4ad0-9356-42557ec6bab7 could not be found. Nov 02 14:51:21.244120 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:51:21.244120 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:51:21.244120 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:51:21.244120 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:51:21.244120 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:51:21.244120 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:51:21.244120 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:51:21.244120 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:51:21.244120 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:51:21.245965 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:51:21.245965 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:51:21.245965 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:51:21.245965 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:51:21.245965 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:51:21.245965 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:51:21.245965 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:51:21.245965 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efac2958-b39d-4ad0-9356-42557ec6bab7 could not be found. Nov 02 14:51:21.245965 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:51:21.245965 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:51:21.245965 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:51:21.245965 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:51:21.245965 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:51:21.245965 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:51:21.245965 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:51:21.245965 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:51:21.245965 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efac2958-b39d-4ad0-9356-42557ec6bab7 could not be found. Nov 02 14:51:21.245965 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:51:21.247699 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-541029b2-c5ef-4062-9353-729d63a4358c tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Returning 404 to user: Instance efac2958-b39d-4ad0-9356-42557ec6bab7 could not be found. {{(pid=119659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:51:21.247699 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-541029b2-c5ef-4062-9353-729d63a4358c tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/efac2958-b39d-4ad0-9356-42557ec6bab7" status: 404 len: 111 microversion: 2.1 time: 0.031662 Nov 02 14:51:21.247699 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 523/1017] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:51:21 2022] GET /compute/v2.1/servers/efac2958-b39d-4ad0-9356-42557ec6bab7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:51:21.252079 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-e1b7106f-2b12-4fed-a650-7d2af4aaf119 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '.version_select at 0x7fb24ec0e4c0>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:51:21.354602 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-e1b7106f-2b12-4fed-a650-7d2af4aaf119 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-249575961" status: 202 len: 0 microversion: 2.1 time: 0.106316 Nov 02 14:51:21.355209 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 495/1018] 10.222.0.30 () {58 vars in 1218 bytes} [Wed Nov 2 14:51:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-249575961 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:51:23.368004 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-366fdcd5-5bff-4163-80e8-d977ff374663 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:51:23.369589 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-366fdcd5-5bff-4163-80e8-d977ff374663 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: efac2958-b39d-4ad0-9356-42557ec6bab7] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:51:23.376019 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-366fdcd5-5bff-4163-80e8-d977ff374663 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:23.376497 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-366fdcd5-5bff-4163-80e8-d977ff374663 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:23.376929 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-366fdcd5-5bff-4163-80e8-d977ff374663 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:23.377656 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-366fdcd5-5bff-4163-80e8-d977ff374663 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:23.378138 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-366fdcd5-5bff-4163-80e8-d977ff374663 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:23.378562 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-366fdcd5-5bff-4163-80e8-d977ff374663 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:23.392105 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.wsgi [None req-366fdcd5-5bff-4163-80e8-d977ff374663 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] HTTP exception thrown: Instance efac2958-b39d-4ad0-9356-42557ec6bab7 could not be found. Nov 02 14:51:23.393737 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-366fdcd5-5bff-4163-80e8-d977ff374663 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Request method failure captured: Nov 02 14:51:23.393737 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: request: DELETE /compute/v2.1/servers/efac2958-b39d-4ad0-9356-42557ec6bab7 HTTP/1.1 Nov 02 14:51:23.393737 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Accept: application/json Nov 02 14:51:23.393737 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Accept-Encoding: identity Nov 02 14:51:23.393737 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Connection: close Nov 02 14:51:23.393737 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Content-Length: 0 Nov 02 14:51:23.393737 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Content-Type: application/json Nov 02 14:51:23.393737 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Host: 10.222.0.30 Nov 02 14:51:23.393737 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Openstack-System-Scope: None Nov 02 14:51:23.393737 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: User-Agent: python-urllib3/1.26.12 Nov 02 14:51:23.393737 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Auth-Token: gAAAAABjYoLLvHsLbLP8fTVuFWPOl6OBOImR3Z5sy0YBc5pcdW4rsQGD2999fEEKagme5Rl64Y-6rgjuI819nWAO1ogYJFLnm9s-YT3gxgnSb4U1lYBBYG0Hxitg6Xb3tz5FVnIsGEbww8BWoFWN4RSJnQNLjjxID_ZFkIwIYop5btRshsuXhyM Nov 02 14:51:23.393737 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Domain-Id: None Nov 02 14:51:23.393737 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Domain-Name: None Nov 02 14:51:23.393737 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Identity-Status: Confirmed Nov 02 14:51:23.393737 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Is-Admin-Project: True Nov 02 14:51:23.393737 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Domain-Id: default Nov 02 14:51:23.393737 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Domain-Name: Default Nov 02 14:51:23.393737 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Id: e428f318654f446db48445e4570ae2d3 Nov 02 14:51:23.393737 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Name: tempest-AttachVolumeNegativeTest-1274711238 Nov 02 14:51:23.393737 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Role: reader,member Nov 02 14:51:23.393737 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Roles: reader,member Nov 02 14:51:23.395369 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e428f318654f446db48445e4570ae2d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e428f318654f446db48445e4570ae2d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e428f318654f446db48445e4570ae2d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e428f318654f446db48445e4570ae2d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:51:23.395369 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant: tempest-AttachVolumeNegativeTest-1274711238 Nov 02 14:51:23.395369 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant-Id: e428f318654f446db48445e4570ae2d3 Nov 02 14:51:23.395369 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1274711238 Nov 02 14:51:23.395369 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User: tempest-AttachVolumeNegativeTest-1274711238-project Nov 02 14:51:23.395369 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Domain-Id: default Nov 02 14:51:23.395369 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Domain-Name: Default Nov 02 14:51:23.395369 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Id: 7fa761a568644a9399d825498a51f054 Nov 02 14:51:23.395369 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Name: tempest-AttachVolumeNegativeTest-1274711238-project Nov 02 14:51:23.395369 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: method: > Nov 02 14:51:23.395369 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: exception: Instance efac2958-b39d-4ad0-9356-42557ec6bab7 could not be found. Nov 02 14:51:23.395369 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: action_args: {'id': 'efac2958-b39d-4ad0-9356-42557ec6bab7'} Nov 02 14:51:23.396452 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:51:23.396452 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:51:23.396452 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:51:23.396452 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:51:23.396452 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:51:23.396452 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:51:23.396452 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:51:23.396452 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:51:23.396452 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:51:23.396452 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:51:23.396452 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efac2958-b39d-4ad0-9356-42557ec6bab7 could not be found. Nov 02 14:51:23.396452 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:51:23.396452 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:51:23.396452 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:51:23.396452 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:51:23.396452 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:51:23.396452 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:51:23.396452 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:51:23.396452 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:51:23.396452 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:51:23.398022 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:51:23.398022 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:51:23.398022 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:51:23.398022 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:51:23.398022 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:51:23.398022 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:51:23.398022 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:51:23.398022 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:51:23.398022 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:51:23.398022 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efac2958-b39d-4ad0-9356-42557ec6bab7 could not be found. Nov 02 14:51:23.398022 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:51:23.398022 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:51:23.398022 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:51:23.398022 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:51:23.398022 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:51:23.398022 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:51:23.398022 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:51:23.398022 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:51:23.398022 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efac2958-b39d-4ad0-9356-42557ec6bab7 could not be found. Nov 02 14:51:23.398022 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:51:23.399865 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-366fdcd5-5bff-4163-80e8-d977ff374663 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Returning 404 to user: Instance efac2958-b39d-4ad0-9356-42557ec6bab7 could not be found. {{(pid=119659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:51:23.399865 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-366fdcd5-5bff-4163-80e8-d977ff374663 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "DELETE /compute/v2.1/servers/efac2958-b39d-4ad0-9356-42557ec6bab7" status: 404 len: 111 microversion: 2.1 time: 0.030973 Nov 02 14:51:23.399865 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 524/1019] 10.222.0.30 () {58 vars in 1239 bytes} [Wed Nov 2 14:51:23 2022] DELETE /compute/v2.1/servers/efac2958-b39d-4ad0-9356-42557ec6bab7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:51:23.403733 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-6329cb1f-df38-426d-9eec-ae6a5eb258df tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:51:23.404351 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-6329cb1f-df38-426d-9eec-ae6a5eb258df tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: efac2958-b39d-4ad0-9356-42557ec6bab7] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:51:23.411456 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6329cb1f-df38-426d-9eec-ae6a5eb258df tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:23.411941 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6329cb1f-df38-426d-9eec-ae6a5eb258df tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:23.412385 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6329cb1f-df38-426d-9eec-ae6a5eb258df tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:23.413111 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6329cb1f-df38-426d-9eec-ae6a5eb258df tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:23.413577 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6329cb1f-df38-426d-9eec-ae6a5eb258df tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:23.414008 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6329cb1f-df38-426d-9eec-ae6a5eb258df tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:23.427895 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.wsgi [None req-6329cb1f-df38-426d-9eec-ae6a5eb258df tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] HTTP exception thrown: Instance efac2958-b39d-4ad0-9356-42557ec6bab7 could not be found. Nov 02 14:51:23.429595 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-6329cb1f-df38-426d-9eec-ae6a5eb258df tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Request method failure captured: Nov 02 14:51:23.429595 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: request: GET /compute/v2.1/servers/efac2958-b39d-4ad0-9356-42557ec6bab7 HTTP/1.1 Nov 02 14:51:23.429595 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Accept: application/json Nov 02 14:51:23.429595 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Accept-Encoding: identity Nov 02 14:51:23.429595 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Connection: close Nov 02 14:51:23.429595 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Content-Length: 0 Nov 02 14:51:23.429595 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Content-Type: application/json Nov 02 14:51:23.429595 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Host: 10.222.0.30 Nov 02 14:51:23.429595 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Openstack-System-Scope: None Nov 02 14:51:23.429595 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: User-Agent: python-urllib3/1.26.12 Nov 02 14:51:23.429595 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Auth-Token: gAAAAABjYoLLvHsLbLP8fTVuFWPOl6OBOImR3Z5sy0YBc5pcdW4rsQGD2999fEEKagme5Rl64Y-6rgjuI819nWAO1ogYJFLnm9s-YT3gxgnSb4U1lYBBYG0Hxitg6Xb3tz5FVnIsGEbww8BWoFWN4RSJnQNLjjxID_ZFkIwIYop5btRshsuXhyM Nov 02 14:51:23.429595 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Domain-Id: None Nov 02 14:51:23.429595 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Domain-Name: None Nov 02 14:51:23.429595 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Identity-Status: Confirmed Nov 02 14:51:23.429595 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Is-Admin-Project: True Nov 02 14:51:23.429595 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Domain-Id: default Nov 02 14:51:23.429595 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Domain-Name: Default Nov 02 14:51:23.429595 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Id: e428f318654f446db48445e4570ae2d3 Nov 02 14:51:23.429595 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Name: tempest-AttachVolumeNegativeTest-1274711238 Nov 02 14:51:23.429595 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Role: reader,member Nov 02 14:51:23.429595 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Roles: reader,member Nov 02 14:51:23.432093 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e428f318654f446db48445e4570ae2d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e428f318654f446db48445e4570ae2d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e428f318654f446db48445e4570ae2d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e428f318654f446db48445e4570ae2d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:51:23.432093 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant: tempest-AttachVolumeNegativeTest-1274711238 Nov 02 14:51:23.432093 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant-Id: e428f318654f446db48445e4570ae2d3 Nov 02 14:51:23.432093 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1274711238 Nov 02 14:51:23.432093 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User: tempest-AttachVolumeNegativeTest-1274711238-project Nov 02 14:51:23.432093 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Domain-Id: default Nov 02 14:51:23.432093 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Domain-Name: Default Nov 02 14:51:23.432093 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Id: 7fa761a568644a9399d825498a51f054 Nov 02 14:51:23.432093 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Name: tempest-AttachVolumeNegativeTest-1274711238-project Nov 02 14:51:23.432093 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: method: > Nov 02 14:51:23.432093 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: exception: Instance efac2958-b39d-4ad0-9356-42557ec6bab7 could not be found. Nov 02 14:51:23.432093 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: action_args: {'id': 'efac2958-b39d-4ad0-9356-42557ec6bab7'} Nov 02 14:51:23.433196 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:51:23.433196 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:51:23.433196 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:51:23.433196 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:51:23.433196 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:51:23.433196 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:51:23.433196 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:51:23.433196 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:51:23.433196 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:51:23.433196 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:51:23.433196 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efac2958-b39d-4ad0-9356-42557ec6bab7 could not be found. Nov 02 14:51:23.433196 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:51:23.433196 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:51:23.433196 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:51:23.433196 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:51:23.433196 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:51:23.433196 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:51:23.433196 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:51:23.433196 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:51:23.433196 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:51:23.434768 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:51:23.434768 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:51:23.434768 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:51:23.434768 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:51:23.434768 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:51:23.434768 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:51:23.434768 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:51:23.434768 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efac2958-b39d-4ad0-9356-42557ec6bab7 could not be found. Nov 02 14:51:23.434768 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:51:23.434768 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:51:23.434768 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:51:23.434768 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:51:23.434768 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:51:23.434768 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:51:23.434768 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:51:23.434768 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:51:23.434768 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efac2958-b39d-4ad0-9356-42557ec6bab7 could not be found. Nov 02 14:51:23.434768 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:51:23.436079 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-6329cb1f-df38-426d-9eec-ae6a5eb258df tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Returning 404 to user: Instance efac2958-b39d-4ad0-9356-42557ec6bab7 could not be found. {{(pid=119658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:51:23.436079 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-6329cb1f-df38-426d-9eec-ae6a5eb258df tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/efac2958-b39d-4ad0-9356-42557ec6bab7" status: 404 len: 111 microversion: 2.1 time: 0.031258 Nov 02 14:51:23.436079 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 496/1020] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:51:23 2022] GET /compute/v2.1/servers/efac2958-b39d-4ad0-9356-42557ec6bab7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:51:24.673477 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-a86e7895-8dba-489a-ad8f-93bea1efb287 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:51:24.673983 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-a86e7895-8dba-489a-ad8f-93bea1efb287 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 7865fba9-1731-407f-a709-d60f1432e269] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:51:24.680471 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a86e7895-8dba-489a-ad8f-93bea1efb287 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:24.681502 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a86e7895-8dba-489a-ad8f-93bea1efb287 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:24.681932 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a86e7895-8dba-489a-ad8f-93bea1efb287 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:24.682627 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a86e7895-8dba-489a-ad8f-93bea1efb287 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:24.683071 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a86e7895-8dba-489a-ad8f-93bea1efb287 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:24.683486 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a86e7895-8dba-489a-ad8f-93bea1efb287 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:24.700208 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.wsgi [None req-a86e7895-8dba-489a-ad8f-93bea1efb287 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] HTTP exception thrown: Instance 7865fba9-1731-407f-a709-d60f1432e269 could not be found. Nov 02 14:51:24.701798 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-a86e7895-8dba-489a-ad8f-93bea1efb287 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Request method failure captured: Nov 02 14:51:24.701798 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: request: DELETE /compute/v2.1/servers/7865fba9-1731-407f-a709-d60f1432e269 HTTP/1.1 Nov 02 14:51:24.701798 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Accept: application/json Nov 02 14:51:24.701798 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Accept-Encoding: identity Nov 02 14:51:24.701798 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Connection: close Nov 02 14:51:24.701798 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Content-Length: 0 Nov 02 14:51:24.701798 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Content-Type: application/json Nov 02 14:51:24.701798 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Host: 10.222.0.30 Nov 02 14:51:24.701798 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Openstack-System-Scope: None Nov 02 14:51:24.701798 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: User-Agent: python-urllib3/1.26.12 Nov 02 14:51:24.701798 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Auth-Token: gAAAAABjYoLLvHsLbLP8fTVuFWPOl6OBOImR3Z5sy0YBc5pcdW4rsQGD2999fEEKagme5Rl64Y-6rgjuI819nWAO1ogYJFLnm9s-YT3gxgnSb4U1lYBBYG0Hxitg6Xb3tz5FVnIsGEbww8BWoFWN4RSJnQNLjjxID_ZFkIwIYop5btRshsuXhyM Nov 02 14:51:24.701798 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Domain-Id: None Nov 02 14:51:24.701798 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Domain-Name: None Nov 02 14:51:24.701798 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Identity-Status: Confirmed Nov 02 14:51:24.701798 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Is-Admin-Project: True Nov 02 14:51:24.701798 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Domain-Id: default Nov 02 14:51:24.701798 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Domain-Name: Default Nov 02 14:51:24.701798 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Id: e428f318654f446db48445e4570ae2d3 Nov 02 14:51:24.701798 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Name: tempest-AttachVolumeNegativeTest-1274711238 Nov 02 14:51:24.701798 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Role: reader,member Nov 02 14:51:24.701798 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Roles: reader,member Nov 02 14:51:24.703485 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e428f318654f446db48445e4570ae2d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e428f318654f446db48445e4570ae2d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e428f318654f446db48445e4570ae2d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e428f318654f446db48445e4570ae2d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:51:24.703485 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant: tempest-AttachVolumeNegativeTest-1274711238 Nov 02 14:51:24.703485 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant-Id: e428f318654f446db48445e4570ae2d3 Nov 02 14:51:24.703485 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1274711238 Nov 02 14:51:24.703485 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User: tempest-AttachVolumeNegativeTest-1274711238-project Nov 02 14:51:24.703485 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Domain-Id: default Nov 02 14:51:24.703485 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Domain-Name: Default Nov 02 14:51:24.703485 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Id: 7fa761a568644a9399d825498a51f054 Nov 02 14:51:24.703485 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Name: tempest-AttachVolumeNegativeTest-1274711238-project Nov 02 14:51:24.703485 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: method: > Nov 02 14:51:24.703485 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: exception: Instance 7865fba9-1731-407f-a709-d60f1432e269 could not be found. Nov 02 14:51:24.703485 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: action_args: {'id': '7865fba9-1731-407f-a709-d60f1432e269'} Nov 02 14:51:24.704434 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:51:24.704434 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:51:24.704434 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:51:24.704434 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:51:24.704434 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:51:24.704434 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:51:24.704434 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:51:24.704434 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:51:24.704434 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:51:24.704434 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:51:24.704434 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7865fba9-1731-407f-a709-d60f1432e269 could not be found. Nov 02 14:51:24.704434 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:51:24.704434 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:51:24.704434 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:51:24.704434 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:51:24.704434 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:51:24.704434 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:51:24.704434 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:51:24.704434 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:51:24.704434 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:51:24.706032 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:51:24.706032 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:51:24.706032 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:51:24.706032 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:51:24.706032 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:51:24.706032 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:51:24.706032 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:51:24.706032 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:51:24.706032 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:51:24.706032 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7865fba9-1731-407f-a709-d60f1432e269 could not be found. Nov 02 14:51:24.706032 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:51:24.706032 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:51:24.706032 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:51:24.706032 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:51:24.706032 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:51:24.706032 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:51:24.706032 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:51:24.706032 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:51:24.706032 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7865fba9-1731-407f-a709-d60f1432e269 could not be found. Nov 02 14:51:24.706032 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:51:24.707568 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-a86e7895-8dba-489a-ad8f-93bea1efb287 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Returning 404 to user: Instance 7865fba9-1731-407f-a709-d60f1432e269 could not be found. {{(pid=119659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:51:24.707568 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-a86e7895-8dba-489a-ad8f-93bea1efb287 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7865fba9-1731-407f-a709-d60f1432e269" status: 404 len: 111 microversion: 2.1 time: 0.033608 Nov 02 14:51:24.707568 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 525/1021] 10.222.0.30 () {58 vars in 1239 bytes} [Wed Nov 2 14:51:24 2022] DELETE /compute/v2.1/servers/7865fba9-1731-407f-a709-d60f1432e269 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:51:24.711615 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-13f06bf3-52aa-46bb-b63c-94f853c99501 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:51:24.712512 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-13f06bf3-52aa-46bb-b63c-94f853c99501 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 7865fba9-1731-407f-a709-d60f1432e269] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:51:24.719068 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-13f06bf3-52aa-46bb-b63c-94f853c99501 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:24.719547 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-13f06bf3-52aa-46bb-b63c-94f853c99501 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:24.719988 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-13f06bf3-52aa-46bb-b63c-94f853c99501 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:24.720680 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-13f06bf3-52aa-46bb-b63c-94f853c99501 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:24.721161 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-13f06bf3-52aa-46bb-b63c-94f853c99501 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:24.721587 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-13f06bf3-52aa-46bb-b63c-94f853c99501 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:24.735037 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.wsgi [None req-13f06bf3-52aa-46bb-b63c-94f853c99501 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] HTTP exception thrown: Instance 7865fba9-1731-407f-a709-d60f1432e269 could not be found. Nov 02 14:51:24.736571 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-13f06bf3-52aa-46bb-b63c-94f853c99501 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Request method failure captured: Nov 02 14:51:24.736571 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: request: GET /compute/v2.1/servers/7865fba9-1731-407f-a709-d60f1432e269 HTTP/1.1 Nov 02 14:51:24.736571 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Accept: application/json Nov 02 14:51:24.736571 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Accept-Encoding: identity Nov 02 14:51:24.736571 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Connection: close Nov 02 14:51:24.736571 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Content-Length: 0 Nov 02 14:51:24.736571 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Content-Type: application/json Nov 02 14:51:24.736571 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Host: 10.222.0.30 Nov 02 14:51:24.736571 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Openstack-System-Scope: None Nov 02 14:51:24.736571 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: User-Agent: python-urllib3/1.26.12 Nov 02 14:51:24.736571 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Auth-Token: gAAAAABjYoLLvHsLbLP8fTVuFWPOl6OBOImR3Z5sy0YBc5pcdW4rsQGD2999fEEKagme5Rl64Y-6rgjuI819nWAO1ogYJFLnm9s-YT3gxgnSb4U1lYBBYG0Hxitg6Xb3tz5FVnIsGEbww8BWoFWN4RSJnQNLjjxID_ZFkIwIYop5btRshsuXhyM Nov 02 14:51:24.736571 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Domain-Id: None Nov 02 14:51:24.736571 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Domain-Name: None Nov 02 14:51:24.736571 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Identity-Status: Confirmed Nov 02 14:51:24.736571 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Is-Admin-Project: True Nov 02 14:51:24.736571 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Domain-Id: default Nov 02 14:51:24.736571 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Domain-Name: Default Nov 02 14:51:24.736571 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Id: e428f318654f446db48445e4570ae2d3 Nov 02 14:51:24.736571 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Name: tempest-AttachVolumeNegativeTest-1274711238 Nov 02 14:51:24.736571 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Role: reader,member Nov 02 14:51:24.736571 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Roles: reader,member Nov 02 14:51:24.738218 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e428f318654f446db48445e4570ae2d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e428f318654f446db48445e4570ae2d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e428f318654f446db48445e4570ae2d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e428f318654f446db48445e4570ae2d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:51:24.738218 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant: tempest-AttachVolumeNegativeTest-1274711238 Nov 02 14:51:24.738218 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant-Id: e428f318654f446db48445e4570ae2d3 Nov 02 14:51:24.738218 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1274711238 Nov 02 14:51:24.738218 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User: tempest-AttachVolumeNegativeTest-1274711238-project Nov 02 14:51:24.738218 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Domain-Id: default Nov 02 14:51:24.738218 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Domain-Name: Default Nov 02 14:51:24.738218 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Id: 7fa761a568644a9399d825498a51f054 Nov 02 14:51:24.738218 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Name: tempest-AttachVolumeNegativeTest-1274711238-project Nov 02 14:51:24.738218 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: method: > Nov 02 14:51:24.738218 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: exception: Instance 7865fba9-1731-407f-a709-d60f1432e269 could not be found. Nov 02 14:51:24.738218 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: action_args: {'id': '7865fba9-1731-407f-a709-d60f1432e269'} Nov 02 14:51:24.739054 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:51:24.739054 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:51:24.739054 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:51:24.739054 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:51:24.739054 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:51:24.739054 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:51:24.739054 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:51:24.739054 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:51:24.739054 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:51:24.739054 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:51:24.739054 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7865fba9-1731-407f-a709-d60f1432e269 could not be found. Nov 02 14:51:24.739054 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:51:24.739054 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:51:24.739054 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:51:24.739054 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:51:24.739054 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:51:24.739054 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:51:24.739054 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:51:24.739054 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:51:24.739054 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:51:24.740424 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:51:24.740424 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:51:24.740424 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:51:24.740424 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:51:24.740424 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:51:24.740424 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:51:24.740424 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:51:24.740424 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7865fba9-1731-407f-a709-d60f1432e269 could not be found. Nov 02 14:51:24.740424 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:51:24.740424 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:51:24.740424 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:51:24.740424 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:51:24.740424 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:51:24.740424 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:51:24.740424 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:51:24.740424 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:51:24.740424 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7865fba9-1731-407f-a709-d60f1432e269 could not be found. Nov 02 14:51:24.740424 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:51:24.741618 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-13f06bf3-52aa-46bb-b63c-94f853c99501 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Returning 404 to user: Instance 7865fba9-1731-407f-a709-d60f1432e269 could not be found. {{(pid=119658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:51:24.741618 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-13f06bf3-52aa-46bb-b63c-94f853c99501 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/7865fba9-1731-407f-a709-d60f1432e269" status: 404 len: 111 microversion: 2.1 time: 0.030154 Nov 02 14:51:24.741618 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 497/1022] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:51:24 2022] GET /compute/v2.1/servers/7865fba9-1731-407f-a709-d60f1432e269 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:51:24.747568 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-0f6ea1bf-052a-46b9-9a26-a7403f3cea5b tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:51:24.748060 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-0f6ea1bf-052a-46b9-9a26-a7403f3cea5b tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 7a7f3c5c-5f77-4d84-bf07-f73e7929f286] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:51:24.754044 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0f6ea1bf-052a-46b9-9a26-a7403f3cea5b tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:24.754523 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0f6ea1bf-052a-46b9-9a26-a7403f3cea5b tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:24.754959 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0f6ea1bf-052a-46b9-9a26-a7403f3cea5b tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:24.755658 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0f6ea1bf-052a-46b9-9a26-a7403f3cea5b tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:24.756105 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0f6ea1bf-052a-46b9-9a26-a7403f3cea5b tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:24.756530 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-0f6ea1bf-052a-46b9-9a26-a7403f3cea5b tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:24.770672 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.wsgi [None req-0f6ea1bf-052a-46b9-9a26-a7403f3cea5b tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] HTTP exception thrown: Instance 7a7f3c5c-5f77-4d84-bf07-f73e7929f286 could not be found. Nov 02 14:51:24.772224 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-0f6ea1bf-052a-46b9-9a26-a7403f3cea5b tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Request method failure captured: Nov 02 14:51:24.772224 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: request: DELETE /compute/v2.1/servers/7a7f3c5c-5f77-4d84-bf07-f73e7929f286 HTTP/1.1 Nov 02 14:51:24.772224 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Accept: application/json Nov 02 14:51:24.772224 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Accept-Encoding: identity Nov 02 14:51:24.772224 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Connection: close Nov 02 14:51:24.772224 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Content-Length: 0 Nov 02 14:51:24.772224 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Content-Type: application/json Nov 02 14:51:24.772224 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Host: 10.222.0.30 Nov 02 14:51:24.772224 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Openstack-System-Scope: None Nov 02 14:51:24.772224 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: User-Agent: python-urllib3/1.26.12 Nov 02 14:51:24.772224 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Auth-Token: gAAAAABjYoLLvHsLbLP8fTVuFWPOl6OBOImR3Z5sy0YBc5pcdW4rsQGD2999fEEKagme5Rl64Y-6rgjuI819nWAO1ogYJFLnm9s-YT3gxgnSb4U1lYBBYG0Hxitg6Xb3tz5FVnIsGEbww8BWoFWN4RSJnQNLjjxID_ZFkIwIYop5btRshsuXhyM Nov 02 14:51:24.772224 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Domain-Id: None Nov 02 14:51:24.772224 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Domain-Name: None Nov 02 14:51:24.772224 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Identity-Status: Confirmed Nov 02 14:51:24.772224 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Is-Admin-Project: True Nov 02 14:51:24.772224 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Domain-Id: default Nov 02 14:51:24.772224 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Domain-Name: Default Nov 02 14:51:24.772224 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Id: e428f318654f446db48445e4570ae2d3 Nov 02 14:51:24.772224 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Name: tempest-AttachVolumeNegativeTest-1274711238 Nov 02 14:51:24.772224 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Role: reader,member Nov 02 14:51:24.772224 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Roles: reader,member Nov 02 14:51:24.773896 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e428f318654f446db48445e4570ae2d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e428f318654f446db48445e4570ae2d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e428f318654f446db48445e4570ae2d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e428f318654f446db48445e4570ae2d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:51:24.773896 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant: tempest-AttachVolumeNegativeTest-1274711238 Nov 02 14:51:24.773896 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant-Id: e428f318654f446db48445e4570ae2d3 Nov 02 14:51:24.773896 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1274711238 Nov 02 14:51:24.773896 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User: tempest-AttachVolumeNegativeTest-1274711238-project Nov 02 14:51:24.773896 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Domain-Id: default Nov 02 14:51:24.773896 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Domain-Name: Default Nov 02 14:51:24.773896 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Id: 7fa761a568644a9399d825498a51f054 Nov 02 14:51:24.773896 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Name: tempest-AttachVolumeNegativeTest-1274711238-project Nov 02 14:51:24.773896 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: method: > Nov 02 14:51:24.773896 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: exception: Instance 7a7f3c5c-5f77-4d84-bf07-f73e7929f286 could not be found. Nov 02 14:51:24.773896 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: action_args: {'id': '7a7f3c5c-5f77-4d84-bf07-f73e7929f286'} Nov 02 14:51:24.774782 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:51:24.774782 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:51:24.774782 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:51:24.774782 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:51:24.774782 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:51:24.774782 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:51:24.774782 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:51:24.774782 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:51:24.774782 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:51:24.774782 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:51:24.774782 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a7f3c5c-5f77-4d84-bf07-f73e7929f286 could not be found. Nov 02 14:51:24.774782 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:51:24.774782 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:51:24.774782 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:51:24.774782 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:51:24.774782 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:51:24.774782 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:51:24.774782 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:51:24.774782 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:51:24.774782 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:51:24.776216 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:51:24.776216 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:51:24.776216 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:51:24.776216 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:51:24.776216 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:51:24.776216 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:51:24.776216 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:51:24.776216 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:51:24.776216 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:51:24.776216 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a7f3c5c-5f77-4d84-bf07-f73e7929f286 could not be found. Nov 02 14:51:24.776216 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:51:24.776216 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:51:24.776216 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:51:24.776216 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:51:24.776216 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:51:24.776216 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:51:24.776216 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:51:24.776216 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:51:24.776216 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a7f3c5c-5f77-4d84-bf07-f73e7929f286 could not be found. Nov 02 14:51:24.776216 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:51:24.777515 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-0f6ea1bf-052a-46b9-9a26-a7403f3cea5b tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Returning 404 to user: Instance 7a7f3c5c-5f77-4d84-bf07-f73e7929f286 could not be found. {{(pid=119659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:51:24.777515 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-0f6ea1bf-052a-46b9-9a26-a7403f3cea5b tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7a7f3c5c-5f77-4d84-bf07-f73e7929f286" status: 404 len: 111 microversion: 2.1 time: 0.030686 Nov 02 14:51:24.777515 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 526/1023] 10.222.0.30 () {58 vars in 1239 bytes} [Wed Nov 2 14:51:24 2022] DELETE /compute/v2.1/servers/7a7f3c5c-5f77-4d84-bf07-f73e7929f286 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:51:24.782353 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-dbe6d34b-954d-4868-b97b-42aa49863b47 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:51:24.783024 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-dbe6d34b-954d-4868-b97b-42aa49863b47 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 7a7f3c5c-5f77-4d84-bf07-f73e7929f286] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:51:24.789534 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-dbe6d34b-954d-4868-b97b-42aa49863b47 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:24.790415 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-dbe6d34b-954d-4868-b97b-42aa49863b47 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:24.790802 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-dbe6d34b-954d-4868-b97b-42aa49863b47 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:24.791506 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-dbe6d34b-954d-4868-b97b-42aa49863b47 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:24.791967 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-dbe6d34b-954d-4868-b97b-42aa49863b47 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:24.792396 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-dbe6d34b-954d-4868-b97b-42aa49863b47 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:24.807451 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.wsgi [None req-dbe6d34b-954d-4868-b97b-42aa49863b47 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] HTTP exception thrown: Instance 7a7f3c5c-5f77-4d84-bf07-f73e7929f286 could not be found. Nov 02 14:51:24.809206 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-dbe6d34b-954d-4868-b97b-42aa49863b47 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Request method failure captured: Nov 02 14:51:24.809206 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: request: GET /compute/v2.1/servers/7a7f3c5c-5f77-4d84-bf07-f73e7929f286 HTTP/1.1 Nov 02 14:51:24.809206 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Accept: application/json Nov 02 14:51:24.809206 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Accept-Encoding: identity Nov 02 14:51:24.809206 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Connection: close Nov 02 14:51:24.809206 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Content-Length: 0 Nov 02 14:51:24.809206 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Content-Type: application/json Nov 02 14:51:24.809206 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Host: 10.222.0.30 Nov 02 14:51:24.809206 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Openstack-System-Scope: None Nov 02 14:51:24.809206 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: User-Agent: python-urllib3/1.26.12 Nov 02 14:51:24.809206 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Auth-Token: gAAAAABjYoLLvHsLbLP8fTVuFWPOl6OBOImR3Z5sy0YBc5pcdW4rsQGD2999fEEKagme5Rl64Y-6rgjuI819nWAO1ogYJFLnm9s-YT3gxgnSb4U1lYBBYG0Hxitg6Xb3tz5FVnIsGEbww8BWoFWN4RSJnQNLjjxID_ZFkIwIYop5btRshsuXhyM Nov 02 14:51:24.809206 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Domain-Id: None Nov 02 14:51:24.809206 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Domain-Name: None Nov 02 14:51:24.809206 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Identity-Status: Confirmed Nov 02 14:51:24.809206 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Is-Admin-Project: True Nov 02 14:51:24.809206 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Domain-Id: default Nov 02 14:51:24.809206 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Domain-Name: Default Nov 02 14:51:24.809206 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Id: e428f318654f446db48445e4570ae2d3 Nov 02 14:51:24.809206 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Name: tempest-AttachVolumeNegativeTest-1274711238 Nov 02 14:51:24.809206 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Role: reader,member Nov 02 14:51:24.809206 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Roles: reader,member Nov 02 14:51:24.810820 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e428f318654f446db48445e4570ae2d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e428f318654f446db48445e4570ae2d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e428f318654f446db48445e4570ae2d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e428f318654f446db48445e4570ae2d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:51:24.810820 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant: tempest-AttachVolumeNegativeTest-1274711238 Nov 02 14:51:24.810820 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant-Id: e428f318654f446db48445e4570ae2d3 Nov 02 14:51:24.810820 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1274711238 Nov 02 14:51:24.810820 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User: tempest-AttachVolumeNegativeTest-1274711238-project Nov 02 14:51:24.810820 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Domain-Id: default Nov 02 14:51:24.810820 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Domain-Name: Default Nov 02 14:51:24.810820 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Id: 7fa761a568644a9399d825498a51f054 Nov 02 14:51:24.810820 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Name: tempest-AttachVolumeNegativeTest-1274711238-project Nov 02 14:51:24.810820 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: method: > Nov 02 14:51:24.810820 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: exception: Instance 7a7f3c5c-5f77-4d84-bf07-f73e7929f286 could not be found. Nov 02 14:51:24.810820 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: action_args: {'id': '7a7f3c5c-5f77-4d84-bf07-f73e7929f286'} Nov 02 14:51:24.811828 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:51:24.811828 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:51:24.811828 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:51:24.811828 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:51:24.811828 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:51:24.811828 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:51:24.811828 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:51:24.811828 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:51:24.811828 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:51:24.811828 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:51:24.811828 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a7f3c5c-5f77-4d84-bf07-f73e7929f286 could not be found. Nov 02 14:51:24.811828 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:51:24.811828 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:51:24.811828 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:51:24.811828 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:51:24.811828 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:51:24.811828 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:51:24.811828 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:51:24.811828 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:51:24.811828 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:51:24.813493 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:51:24.813493 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:51:24.813493 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:51:24.813493 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:51:24.813493 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:51:24.813493 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:51:24.813493 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:51:24.813493 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a7f3c5c-5f77-4d84-bf07-f73e7929f286 could not be found. Nov 02 14:51:24.813493 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:51:24.813493 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:51:24.813493 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:51:24.813493 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:51:24.813493 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:51:24.813493 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:51:24.813493 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:51:24.813493 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:51:24.813493 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a7f3c5c-5f77-4d84-bf07-f73e7929f286 could not be found. Nov 02 14:51:24.813493 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:51:24.814902 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-dbe6d34b-954d-4868-b97b-42aa49863b47 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Returning 404 to user: Instance 7a7f3c5c-5f77-4d84-bf07-f73e7929f286 could not be found. {{(pid=119658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:51:24.814902 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-dbe6d34b-954d-4868-b97b-42aa49863b47 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/7a7f3c5c-5f77-4d84-bf07-f73e7929f286" status: 404 len: 111 microversion: 2.1 time: 0.032101 Nov 02 14:51:24.814902 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 498/1024] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:51:24 2022] GET /compute/v2.1/servers/7a7f3c5c-5f77-4d84-bf07-f73e7929f286 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:51:26.123528 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-c025881c-5e45-4ebc-96de-2bb0c70665b4 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:51:26.124032 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-c025881c-5e45-4ebc-96de-2bb0c70665b4 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 015a2580-2374-494d-a62d-8ea86c25b6d4] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:51:26.130484 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c025881c-5e45-4ebc-96de-2bb0c70665b4 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:26.130968 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c025881c-5e45-4ebc-96de-2bb0c70665b4 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:26.131415 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c025881c-5e45-4ebc-96de-2bb0c70665b4 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:26.132103 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c025881c-5e45-4ebc-96de-2bb0c70665b4 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:26.132559 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c025881c-5e45-4ebc-96de-2bb0c70665b4 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:26.132987 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c025881c-5e45-4ebc-96de-2bb0c70665b4 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:26.146655 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.wsgi [None req-c025881c-5e45-4ebc-96de-2bb0c70665b4 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] HTTP exception thrown: Instance 015a2580-2374-494d-a62d-8ea86c25b6d4 could not be found. Nov 02 14:51:26.148213 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-c025881c-5e45-4ebc-96de-2bb0c70665b4 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Request method failure captured: Nov 02 14:51:26.148213 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: request: DELETE /compute/v2.1/servers/015a2580-2374-494d-a62d-8ea86c25b6d4 HTTP/1.1 Nov 02 14:51:26.148213 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Accept: application/json Nov 02 14:51:26.148213 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Accept-Encoding: identity Nov 02 14:51:26.148213 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Connection: close Nov 02 14:51:26.148213 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Content-Length: 0 Nov 02 14:51:26.148213 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Content-Type: application/json Nov 02 14:51:26.148213 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Host: 10.222.0.30 Nov 02 14:51:26.148213 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Openstack-System-Scope: None Nov 02 14:51:26.148213 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: User-Agent: python-urllib3/1.26.12 Nov 02 14:51:26.148213 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Auth-Token: gAAAAABjYoLLvHsLbLP8fTVuFWPOl6OBOImR3Z5sy0YBc5pcdW4rsQGD2999fEEKagme5Rl64Y-6rgjuI819nWAO1ogYJFLnm9s-YT3gxgnSb4U1lYBBYG0Hxitg6Xb3tz5FVnIsGEbww8BWoFWN4RSJnQNLjjxID_ZFkIwIYop5btRshsuXhyM Nov 02 14:51:26.148213 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Domain-Id: None Nov 02 14:51:26.148213 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Domain-Name: None Nov 02 14:51:26.148213 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Identity-Status: Confirmed Nov 02 14:51:26.148213 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Is-Admin-Project: True Nov 02 14:51:26.148213 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Domain-Id: default Nov 02 14:51:26.148213 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Domain-Name: Default Nov 02 14:51:26.148213 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Id: e428f318654f446db48445e4570ae2d3 Nov 02 14:51:26.148213 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Name: tempest-AttachVolumeNegativeTest-1274711238 Nov 02 14:51:26.148213 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Role: reader,member Nov 02 14:51:26.148213 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Roles: reader,member Nov 02 14:51:26.150271 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e428f318654f446db48445e4570ae2d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e428f318654f446db48445e4570ae2d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e428f318654f446db48445e4570ae2d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e428f318654f446db48445e4570ae2d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:51:26.150271 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant: tempest-AttachVolumeNegativeTest-1274711238 Nov 02 14:51:26.150271 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant-Id: e428f318654f446db48445e4570ae2d3 Nov 02 14:51:26.150271 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1274711238 Nov 02 14:51:26.150271 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User: tempest-AttachVolumeNegativeTest-1274711238-project Nov 02 14:51:26.150271 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Domain-Id: default Nov 02 14:51:26.150271 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Domain-Name: Default Nov 02 14:51:26.150271 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Id: 7fa761a568644a9399d825498a51f054 Nov 02 14:51:26.150271 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Name: tempest-AttachVolumeNegativeTest-1274711238-project Nov 02 14:51:26.150271 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: method: > Nov 02 14:51:26.150271 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: exception: Instance 015a2580-2374-494d-a62d-8ea86c25b6d4 could not be found. Nov 02 14:51:26.150271 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: action_args: {'id': '015a2580-2374-494d-a62d-8ea86c25b6d4'} Nov 02 14:51:26.151051 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:51:26.151051 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:51:26.151051 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:51:26.151051 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:51:26.151051 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:51:26.151051 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:51:26.151051 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:51:26.151051 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:51:26.151051 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:51:26.151051 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:51:26.151051 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 015a2580-2374-494d-a62d-8ea86c25b6d4 could not be found. Nov 02 14:51:26.151051 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:51:26.151051 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:51:26.151051 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:51:26.151051 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:51:26.151051 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:51:26.151051 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:51:26.151051 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:51:26.151051 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:51:26.151051 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:51:26.152593 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:51:26.152593 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:51:26.152593 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:51:26.152593 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:51:26.152593 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:51:26.152593 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:51:26.152593 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:51:26.152593 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:51:26.152593 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:51:26.152593 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 015a2580-2374-494d-a62d-8ea86c25b6d4 could not be found. Nov 02 14:51:26.152593 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:51:26.152593 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:51:26.152593 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:51:26.152593 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:51:26.152593 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:51:26.152593 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:51:26.152593 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:51:26.152593 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:51:26.152593 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 015a2580-2374-494d-a62d-8ea86c25b6d4 could not be found. Nov 02 14:51:26.152593 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:51:26.154279 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-c025881c-5e45-4ebc-96de-2bb0c70665b4 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Returning 404 to user: Instance 015a2580-2374-494d-a62d-8ea86c25b6d4 could not be found. {{(pid=119659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:51:26.154279 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-c025881c-5e45-4ebc-96de-2bb0c70665b4 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "DELETE /compute/v2.1/servers/015a2580-2374-494d-a62d-8ea86c25b6d4" status: 404 len: 111 microversion: 2.1 time: 0.030260 Nov 02 14:51:26.154279 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 527/1025] 10.222.0.30 () {58 vars in 1239 bytes} [Wed Nov 2 14:51:26 2022] DELETE /compute/v2.1/servers/015a2580-2374-494d-a62d-8ea86c25b6d4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 14:51:26.159363 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-c3a6d3fb-71b6-4a57-add9-11fe8c1d5fb0 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:51:26.159950 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-c3a6d3fb-71b6-4a57-add9-11fe8c1d5fb0 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] [instance: 015a2580-2374-494d-a62d-8ea86c25b6d4] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:51:26.167117 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c3a6d3fb-71b6-4a57-add9-11fe8c1d5fb0 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:26.167594 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c3a6d3fb-71b6-4a57-add9-11fe8c1d5fb0 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:26.168035 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c3a6d3fb-71b6-4a57-add9-11fe8c1d5fb0 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:26.168759 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c3a6d3fb-71b6-4a57-add9-11fe8c1d5fb0 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:26.169243 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c3a6d3fb-71b6-4a57-add9-11fe8c1d5fb0 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:26.169668 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c3a6d3fb-71b6-4a57-add9-11fe8c1d5fb0 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:26.184461 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.wsgi [None req-c3a6d3fb-71b6-4a57-add9-11fe8c1d5fb0 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] HTTP exception thrown: Instance 015a2580-2374-494d-a62d-8ea86c25b6d4 could not be found. Nov 02 14:51:26.186000 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-c3a6d3fb-71b6-4a57-add9-11fe8c1d5fb0 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Request method failure captured: Nov 02 14:51:26.186000 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: request: GET /compute/v2.1/servers/015a2580-2374-494d-a62d-8ea86c25b6d4 HTTP/1.1 Nov 02 14:51:26.186000 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Accept: application/json Nov 02 14:51:26.186000 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Accept-Encoding: identity Nov 02 14:51:26.186000 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Connection: close Nov 02 14:51:26.186000 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Content-Length: 0 Nov 02 14:51:26.186000 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Content-Type: application/json Nov 02 14:51:26.186000 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Host: 10.222.0.30 Nov 02 14:51:26.186000 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Openstack-System-Scope: None Nov 02 14:51:26.186000 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: User-Agent: python-urllib3/1.26.12 Nov 02 14:51:26.186000 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Auth-Token: gAAAAABjYoLLvHsLbLP8fTVuFWPOl6OBOImR3Z5sy0YBc5pcdW4rsQGD2999fEEKagme5Rl64Y-6rgjuI819nWAO1ogYJFLnm9s-YT3gxgnSb4U1lYBBYG0Hxitg6Xb3tz5FVnIsGEbww8BWoFWN4RSJnQNLjjxID_ZFkIwIYop5btRshsuXhyM Nov 02 14:51:26.186000 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Domain-Id: None Nov 02 14:51:26.186000 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Domain-Name: None Nov 02 14:51:26.186000 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Identity-Status: Confirmed Nov 02 14:51:26.186000 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Is-Admin-Project: True Nov 02 14:51:26.186000 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Domain-Id: default Nov 02 14:51:26.186000 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Domain-Name: Default Nov 02 14:51:26.186000 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Id: e428f318654f446db48445e4570ae2d3 Nov 02 14:51:26.186000 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Name: tempest-AttachVolumeNegativeTest-1274711238 Nov 02 14:51:26.186000 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Role: reader,member Nov 02 14:51:26.186000 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Roles: reader,member Nov 02 14:51:26.187713 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e428f318654f446db48445e4570ae2d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e428f318654f446db48445e4570ae2d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e428f318654f446db48445e4570ae2d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e428f318654f446db48445e4570ae2d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:51:26.187713 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant: tempest-AttachVolumeNegativeTest-1274711238 Nov 02 14:51:26.187713 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant-Id: e428f318654f446db48445e4570ae2d3 Nov 02 14:51:26.187713 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1274711238 Nov 02 14:51:26.187713 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User: tempest-AttachVolumeNegativeTest-1274711238-project Nov 02 14:51:26.187713 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Domain-Id: default Nov 02 14:51:26.187713 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Domain-Name: Default Nov 02 14:51:26.187713 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Id: 7fa761a568644a9399d825498a51f054 Nov 02 14:51:26.187713 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Name: tempest-AttachVolumeNegativeTest-1274711238-project Nov 02 14:51:26.187713 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: method: > Nov 02 14:51:26.187713 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: exception: Instance 015a2580-2374-494d-a62d-8ea86c25b6d4 could not be found. Nov 02 14:51:26.187713 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: action_args: {'id': '015a2580-2374-494d-a62d-8ea86c25b6d4'} Nov 02 14:51:26.188707 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:51:26.188707 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:51:26.188707 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:51:26.188707 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:51:26.188707 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:51:26.188707 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:51:26.188707 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:51:26.188707 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:51:26.188707 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:51:26.188707 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:51:26.188707 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 015a2580-2374-494d-a62d-8ea86c25b6d4 could not be found. Nov 02 14:51:26.188707 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:51:26.188707 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:51:26.188707 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:51:26.188707 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:51:26.188707 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:51:26.188707 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:51:26.188707 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:51:26.188707 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:51:26.188707 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:51:26.190294 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:51:26.190294 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:51:26.190294 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:51:26.190294 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:51:26.190294 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:51:26.190294 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:51:26.190294 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:51:26.190294 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 015a2580-2374-494d-a62d-8ea86c25b6d4 could not be found. Nov 02 14:51:26.190294 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:51:26.190294 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:51:26.190294 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:51:26.190294 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:51:26.190294 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:51:26.190294 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:51:26.190294 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:51:26.190294 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:51:26.190294 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 015a2580-2374-494d-a62d-8ea86c25b6d4 could not be found. Nov 02 14:51:26.190294 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:51:26.191788 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-c3a6d3fb-71b6-4a57-add9-11fe8c1d5fb0 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] Returning 404 to user: Instance 015a2580-2374-494d-a62d-8ea86c25b6d4 could not be found. {{(pid=119658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:51:26.191788 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-c3a6d3fb-71b6-4a57-add9-11fe8c1d5fb0 tempest-AttachVolumeNegativeTest-1274711238 tempest-AttachVolumeNegativeTest-1274711238-project] 10.222.0.30 "GET /compute/v2.1/servers/015a2580-2374-494d-a62d-8ea86c25b6d4" status: 404 len: 111 microversion: 2.1 time: 0.032127 Nov 02 14:51:26.191788 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 499/1026] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:51:26 2022] GET /compute/v2.1/servers/015a2580-2374-494d-a62d-8ea86c25b6d4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:51:32.064225 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 14:51:32.064765 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Wed Nov 2 14:51:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes (ip 10.222.0.30) !!! Nov 02 14:51:32.176254 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-531444ab-b0ce-45cc-9bca-cc881a1f4f60 tempest-VolumesNegativeTest-11195648 tempest-VolumesNegativeTest-11195648-project] Action: 'create', calling method: .version_select at 0x7fb24eec6a60>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2109526532", "metadata": {"Type": "work"}}} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:51:32.189908 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-531444ab-b0ce-45cc-9bca-cc881a1f4f60 tempest-VolumesNegativeTest-11195648 tempest-VolumesNegativeTest-11195648-project] Request method failure captured: Nov 02 14:51:32.189908 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Nov 02 14:51:32.189908 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Accept: application/json Nov 02 14:51:32.189908 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Accept-Encoding: identity Nov 02 14:51:32.189908 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Connection: close Nov 02 14:51:32.189908 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Content-Length: 122 Nov 02 14:51:32.189908 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Content-Type: application/json Nov 02 14:51:32.189908 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Host: 10.222.0.30 Nov 02 14:51:32.189908 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Openstack-System-Scope: None Nov 02 14:51:32.189908 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: User-Agent: python-urllib3/1.26.12 Nov 02 14:51:32.189908 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Auth-Token: gAAAAABjYoPzoFIse3f2oHm7RuZytndrGoF_ulsZzWAmFiE8c3C3aZBKuMamAkdS0Ui3Y8pPEhKVOfFO73hBk2yUfHNNqzzKF-zTHqfAroietSxLQSHNnH723U2MiukMu-uGo25_B-j9RXoP87fBAPLO3PdKaKZMk2OAhKdrEtdSNvBb1hnSxqY Nov 02 14:51:32.189908 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Domain-Id: None Nov 02 14:51:32.189908 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Domain-Name: None Nov 02 14:51:32.189908 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Identity-Status: Confirmed Nov 02 14:51:32.189908 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Is-Admin-Project: True Nov 02 14:51:32.189908 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Domain-Id: default Nov 02 14:51:32.189908 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Domain-Name: Default Nov 02 14:51:32.189908 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Id: 9dfe7b7c29f342faa0862767eac362dd Nov 02 14:51:32.189908 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Name: tempest-VolumesNegativeTest-11195648 Nov 02 14:51:32.189908 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Role: reader,member Nov 02 14:51:32.189908 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Roles: reader,member Nov 02 14:51:32.191652 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9dfe7b7c29f342faa0862767eac362dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/9dfe7b7c29f342faa0862767eac362dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9dfe7b7c29f342faa0862767eac362dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_9dfe7b7c29f342faa0862767eac362dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:51:32.191652 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant: tempest-VolumesNegativeTest-11195648 Nov 02 14:51:32.191652 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant-Id: 9dfe7b7c29f342faa0862767eac362dd Nov 02 14:51:32.191652 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant-Name: tempest-VolumesNegativeTest-11195648 Nov 02 14:51:32.191652 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User: tempest-VolumesNegativeTest-11195648-project Nov 02 14:51:32.191652 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Domain-Id: default Nov 02 14:51:32.191652 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Domain-Name: Default Nov 02 14:51:32.191652 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Id: 46cc19d4447d4440a18a716e6f1662fa Nov 02 14:51:32.191652 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Name: tempest-VolumesNegativeTest-11195648-project Nov 02 14:51:32.191652 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Nov 02 14:51:32.191652 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2109526532", "metadata": {"Type": "work"}}} Nov 02 14:51:32.191652 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: method: Nov 02 14:51:32.191652 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Nov 02 14:51:32.192709 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-2109526532', 'metadata': {'Type': 'work'}}}} Nov 02 14:51:32.192709 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:51:32.192709 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:51:32.192709 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 14:51:32.192709 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 14:51:32.192709 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 14:51:32.192709 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise error Nov 02 14:51:32.192709 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Nov 02 14:51:32.192709 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:51:32.192709 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Nov 02 14:51:32.192709 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Nov 02 14:51:32.192709 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:51:32.192709 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi On instance['volume']: Nov 02 14:51:32.192709 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi '#$%' Nov 02 14:51:32.192709 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:51:32.192709 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:51:32.192709 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:51:32.192709 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:51:32.192709 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:51:32.192709 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:51:32.192709 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:51:32.192709 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:51:32.194545 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 14:51:32.194545 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 14:51:32.194545 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:51:32.194545 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:51:32.194545 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 14:51:32.194545 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 14:51:32.194545 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 14:51:32.194545 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 14:51:32.194545 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 14:51:32.194545 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 14:51:32.194545 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Nov 02 14:51:32.194545 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:51:32.194545 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:51:32.194545 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:51:32.194545 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:51:32.194545 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:51:32.194545 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:51:32.194545 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 14:51:32.194545 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 14:51:32.195989 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Nov 02 14:51:32.195989 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:51:32.195989 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-531444ab-b0ce-45cc-9bca-cc881a1f4f60 tempest-VolumesNegativeTest-11195648 tempest-VolumesNegativeTest-11195648-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=119659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:51:32.195989 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-531444ab-b0ce-45cc-9bca-cc881a1f4f60 tempest-VolumesNegativeTest-11195648 tempest-VolumesNegativeTest-11195648-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.131870 Nov 02 14:51:32.195989 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 528/1027] 10.222.0.30 () {60 vars in 1156 bytes} [Wed Nov 2 14:51:32 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 133 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 14:51:32.203220 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-48df46ad-7e4a-43fc-923c-e329d239d62b tempest-VolumesNegativeTest-11195648 tempest-VolumesNegativeTest-11195648-project] Action: 'create', calling method: .version_select at 0x7fb24ed60550>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-729626059", "metadata": {"Type": "work"}}} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:51:32.207929 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-48df46ad-7e4a-43fc-923c-e329d239d62b tempest-VolumesNegativeTest-11195648 tempest-VolumesNegativeTest-11195648-project] Request method failure captured: Nov 02 14:51:32.207929 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Nov 02 14:51:32.207929 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Accept: application/json Nov 02 14:51:32.207929 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Accept-Encoding: identity Nov 02 14:51:32.207929 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Connection: close Nov 02 14:51:32.207929 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Content-Length: 119 Nov 02 14:51:32.207929 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Content-Type: application/json Nov 02 14:51:32.207929 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Host: 10.222.0.30 Nov 02 14:51:32.207929 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Openstack-System-Scope: None Nov 02 14:51:32.207929 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: User-Agent: python-urllib3/1.26.12 Nov 02 14:51:32.207929 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Auth-Token: gAAAAABjYoPzoFIse3f2oHm7RuZytndrGoF_ulsZzWAmFiE8c3C3aZBKuMamAkdS0Ui3Y8pPEhKVOfFO73hBk2yUfHNNqzzKF-zTHqfAroietSxLQSHNnH723U2MiukMu-uGo25_B-j9RXoP87fBAPLO3PdKaKZMk2OAhKdrEtdSNvBb1hnSxqY Nov 02 14:51:32.207929 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Domain-Id: None Nov 02 14:51:32.207929 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Domain-Name: None Nov 02 14:51:32.207929 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Identity-Status: Confirmed Nov 02 14:51:32.207929 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Is-Admin-Project: True Nov 02 14:51:32.207929 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Domain-Id: default Nov 02 14:51:32.207929 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Domain-Name: Default Nov 02 14:51:32.207929 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Id: 9dfe7b7c29f342faa0862767eac362dd Nov 02 14:51:32.207929 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Name: tempest-VolumesNegativeTest-11195648 Nov 02 14:51:32.207929 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Role: reader,member Nov 02 14:51:32.207929 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Roles: reader,member Nov 02 14:51:32.209619 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9dfe7b7c29f342faa0862767eac362dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/9dfe7b7c29f342faa0862767eac362dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9dfe7b7c29f342faa0862767eac362dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_9dfe7b7c29f342faa0862767eac362dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:51:32.209619 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant: tempest-VolumesNegativeTest-11195648 Nov 02 14:51:32.209619 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant-Id: 9dfe7b7c29f342faa0862767eac362dd Nov 02 14:51:32.209619 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant-Name: tempest-VolumesNegativeTest-11195648 Nov 02 14:51:32.209619 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User: tempest-VolumesNegativeTest-11195648-project Nov 02 14:51:32.209619 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Domain-Id: default Nov 02 14:51:32.209619 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Domain-Name: Default Nov 02 14:51:32.209619 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Id: 46cc19d4447d4440a18a716e6f1662fa Nov 02 14:51:32.209619 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Name: tempest-VolumesNegativeTest-11195648-project Nov 02 14:51:32.209619 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Nov 02 14:51:32.209619 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-729626059", "metadata": {"Type": "work"}}} Nov 02 14:51:32.209619 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: method: Nov 02 14:51:32.209619 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Nov 02 14:51:32.210735 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-729626059', 'metadata': {'Type': 'work'}}}} Nov 02 14:51:32.210735 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:51:32.210735 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:51:32.210735 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 14:51:32.210735 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 14:51:32.210735 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 14:51:32.210735 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise error Nov 02 14:51:32.210735 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Nov 02 14:51:32.210735 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:51:32.210735 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Nov 02 14:51:32.210735 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Nov 02 14:51:32.210735 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:51:32.210735 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi On instance['volume']: Nov 02 14:51:32.210735 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi '0' Nov 02 14:51:32.210735 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:51:32.210735 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:51:32.210735 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:51:32.210735 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:51:32.210735 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:51:32.210735 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:51:32.210735 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:51:32.210735 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:51:32.212371 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 14:51:32.212371 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 14:51:32.212371 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:51:32.212371 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:51:32.212371 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 14:51:32.212371 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 14:51:32.212371 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 14:51:32.212371 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 14:51:32.212371 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 14:51:32.212371 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 14:51:32.212371 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Nov 02 14:51:32.212371 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:51:32.212371 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:51:32.212371 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:51:32.212371 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:51:32.212371 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:51:32.212371 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:51:32.212371 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 14:51:32.212371 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 14:51:32.215182 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Nov 02 14:51:32.215182 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:51:32.215182 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-48df46ad-7e4a-43fc-923c-e329d239d62b tempest-VolumesNegativeTest-11195648 tempest-VolumesNegativeTest-11195648-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=119658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:51:32.215182 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-48df46ad-7e4a-43fc-923c-e329d239d62b tempest-VolumesNegativeTest-11195648 tempest-VolumesNegativeTest-11195648-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010065 Nov 02 14:51:32.215182 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 500/1028] 10.222.0.30 () {60 vars in 1156 bytes} [Wed Nov 2 14:51:32 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 14:51:32.222202 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-4c46eb16-4f73-43b4-9c05-5da6c0d7b954 tempest-VolumesNegativeTest-11195648 tempest-VolumesNegativeTest-11195648-project] Action: 'create', calling method: .version_select at 0x7fb24ef415e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-61112438", "metadata": {"Type": "work"}}} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:51:32.226914 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-4c46eb16-4f73-43b4-9c05-5da6c0d7b954 tempest-VolumesNegativeTest-11195648 tempest-VolumesNegativeTest-11195648-project] Request method failure captured: Nov 02 14:51:32.226914 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Nov 02 14:51:32.226914 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Accept: application/json Nov 02 14:51:32.226914 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Accept-Encoding: identity Nov 02 14:51:32.226914 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Connection: close Nov 02 14:51:32.226914 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Content-Length: 117 Nov 02 14:51:32.226914 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Content-Type: application/json Nov 02 14:51:32.226914 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Host: 10.222.0.30 Nov 02 14:51:32.226914 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Openstack-System-Scope: None Nov 02 14:51:32.226914 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: User-Agent: python-urllib3/1.26.12 Nov 02 14:51:32.226914 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Auth-Token: gAAAAABjYoPzoFIse3f2oHm7RuZytndrGoF_ulsZzWAmFiE8c3C3aZBKuMamAkdS0Ui3Y8pPEhKVOfFO73hBk2yUfHNNqzzKF-zTHqfAroietSxLQSHNnH723U2MiukMu-uGo25_B-j9RXoP87fBAPLO3PdKaKZMk2OAhKdrEtdSNvBb1hnSxqY Nov 02 14:51:32.226914 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Domain-Id: None Nov 02 14:51:32.226914 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Domain-Name: None Nov 02 14:51:32.226914 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Identity-Status: Confirmed Nov 02 14:51:32.226914 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Is-Admin-Project: True Nov 02 14:51:32.226914 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Domain-Id: default Nov 02 14:51:32.226914 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Domain-Name: Default Nov 02 14:51:32.226914 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Id: 9dfe7b7c29f342faa0862767eac362dd Nov 02 14:51:32.226914 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Name: tempest-VolumesNegativeTest-11195648 Nov 02 14:51:32.226914 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Role: reader,member Nov 02 14:51:32.226914 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Roles: reader,member Nov 02 14:51:32.229068 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9dfe7b7c29f342faa0862767eac362dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/9dfe7b7c29f342faa0862767eac362dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9dfe7b7c29f342faa0862767eac362dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_9dfe7b7c29f342faa0862767eac362dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:51:32.229068 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant: tempest-VolumesNegativeTest-11195648 Nov 02 14:51:32.229068 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant-Id: 9dfe7b7c29f342faa0862767eac362dd Nov 02 14:51:32.229068 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant-Name: tempest-VolumesNegativeTest-11195648 Nov 02 14:51:32.229068 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User: tempest-VolumesNegativeTest-11195648-project Nov 02 14:51:32.229068 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Domain-Id: default Nov 02 14:51:32.229068 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Domain-Name: Default Nov 02 14:51:32.229068 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Id: 46cc19d4447d4440a18a716e6f1662fa Nov 02 14:51:32.229068 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Name: tempest-VolumesNegativeTest-11195648-project Nov 02 14:51:32.229068 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Nov 02 14:51:32.229068 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-61112438", "metadata": {"Type": "work"}}} Nov 02 14:51:32.229068 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: method: Nov 02 14:51:32.229068 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Nov 02 14:51:32.230123 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-61112438', 'metadata': {'Type': 'work'}}}} Nov 02 14:51:32.230123 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:51:32.230123 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:51:32.230123 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 14:51:32.230123 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 14:51:32.230123 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 14:51:32.230123 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise error Nov 02 14:51:32.230123 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Nov 02 14:51:32.230123 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:51:32.230123 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Nov 02 14:51:32.230123 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Nov 02 14:51:32.230123 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:51:32.230123 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi On instance['volume']: Nov 02 14:51:32.230123 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi '' Nov 02 14:51:32.230123 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:51:32.230123 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:51:32.230123 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:51:32.230123 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:51:32.230123 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:51:32.230123 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:51:32.230123 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:51:32.230123 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:51:32.231748 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 14:51:32.231748 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 14:51:32.231748 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:51:32.231748 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:51:32.231748 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 14:51:32.231748 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 14:51:32.231748 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 14:51:32.231748 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 14:51:32.231748 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 14:51:32.231748 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 14:51:32.231748 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Nov 02 14:51:32.231748 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:51:32.231748 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:51:32.231748 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:51:32.231748 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:51:32.231748 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:51:32.231748 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:51:32.231748 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 14:51:32.231748 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 14:51:32.233202 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Nov 02 14:51:32.233202 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:51:32.233202 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-4c46eb16-4f73-43b4-9c05-5da6c0d7b954 tempest-VolumesNegativeTest-11195648 tempest-VolumesNegativeTest-11195648-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=119659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:51:32.233202 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-4c46eb16-4f73-43b4-9c05-5da6c0d7b954 tempest-VolumesNegativeTest-11195648 tempest-VolumesNegativeTest-11195648-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010018 Nov 02 14:51:32.233202 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 529/1029] 10.222.0.30 () {60 vars in 1156 bytes} [Wed Nov 2 14:51:32 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 14:51:32.241210 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-824a3bf6-1d5e-4e3c-af0d-20e830448b02 tempest-VolumesNegativeTest-11195648 tempest-VolumesNegativeTest-11195648-project] Calling method '.version_select at 0x7fb24f35c9d0>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:51:32.271041 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.wsgi [None req-824a3bf6-1d5e-4e3c-af0d-20e830448b02 tempest-VolumesNegativeTest-11195648 tempest-VolumesNegativeTest-11195648-project] HTTP exception thrown: Volume tempest-invalid-1075807401 could not be found. Nov 02 14:51:32.273233 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-824a3bf6-1d5e-4e3c-af0d-20e830448b02 tempest-VolumesNegativeTest-11195648 tempest-VolumesNegativeTest-11195648-project] Request method failure captured: Nov 02 14:51:32.273233 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1075807401 HTTP/1.1 Nov 02 14:51:32.273233 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Accept: application/json Nov 02 14:51:32.273233 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Accept-Encoding: identity Nov 02 14:51:32.273233 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Connection: close Nov 02 14:51:32.273233 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Content-Length: 0 Nov 02 14:51:32.273233 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Content-Type: application/json Nov 02 14:51:32.273233 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Host: 10.222.0.30 Nov 02 14:51:32.273233 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Openstack-System-Scope: None Nov 02 14:51:32.273233 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: User-Agent: python-urllib3/1.26.12 Nov 02 14:51:32.273233 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Auth-Token: gAAAAABjYoPzoFIse3f2oHm7RuZytndrGoF_ulsZzWAmFiE8c3C3aZBKuMamAkdS0Ui3Y8pPEhKVOfFO73hBk2yUfHNNqzzKF-zTHqfAroietSxLQSHNnH723U2MiukMu-uGo25_B-j9RXoP87fBAPLO3PdKaKZMk2OAhKdrEtdSNvBb1hnSxqY Nov 02 14:51:32.273233 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Domain-Id: None Nov 02 14:51:32.273233 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Domain-Name: None Nov 02 14:51:32.273233 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Identity-Status: Confirmed Nov 02 14:51:32.273233 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Is-Admin-Project: True Nov 02 14:51:32.273233 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Domain-Id: default Nov 02 14:51:32.273233 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Domain-Name: Default Nov 02 14:51:32.273233 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Id: 9dfe7b7c29f342faa0862767eac362dd Nov 02 14:51:32.273233 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Name: tempest-VolumesNegativeTest-11195648 Nov 02 14:51:32.273233 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Role: reader,member Nov 02 14:51:32.273233 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Roles: reader,member Nov 02 14:51:32.274889 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9dfe7b7c29f342faa0862767eac362dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/9dfe7b7c29f342faa0862767eac362dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9dfe7b7c29f342faa0862767eac362dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_9dfe7b7c29f342faa0862767eac362dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:51:32.274889 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant: tempest-VolumesNegativeTest-11195648 Nov 02 14:51:32.274889 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant-Id: 9dfe7b7c29f342faa0862767eac362dd Nov 02 14:51:32.274889 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant-Name: tempest-VolumesNegativeTest-11195648 Nov 02 14:51:32.274889 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User: tempest-VolumesNegativeTest-11195648-project Nov 02 14:51:32.274889 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Domain-Id: default Nov 02 14:51:32.274889 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Domain-Name: Default Nov 02 14:51:32.274889 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Id: 46cc19d4447d4440a18a716e6f1662fa Nov 02 14:51:32.274889 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Name: tempest-VolumesNegativeTest-11195648-project Nov 02 14:51:32.274889 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: method: Nov 02 14:51:32.274889 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: exception: Volume tempest-invalid-1075807401 could not be found. Nov 02 14:51:32.274889 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: action_args: {'id': 'tempest-invalid-1075807401'} Nov 02 14:51:32.274889 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:51:32.276476 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:51:32.276476 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 14:51:32.276476 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 14:51:32.276476 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 14:51:32.276476 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 14:51:32.276476 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 14:51:32.276476 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 14:51:32.276476 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 14:51:32.276476 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 14:51:32.276476 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 14:51:32.276476 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 14:51:32.276476 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 14:51:32.276476 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 14:51:32.276476 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 14:51:32.276476 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 14:51:32.276476 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1075807401 could not be found. (HTTP 404) (Request-ID: req-728840da-9f65-458b-99ba-29a949837a11) Nov 02 14:51:32.276476 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:51:32.276476 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:51:32.276476 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:51:32.277992 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:51:32.277992 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Nov 02 14:51:32.277992 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Nov 02 14:51:32.277992 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 14:51:32.277992 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 14:51:32.277992 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 14:51:32.277992 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 14:51:32.277992 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 14:51:32.277992 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 14:51:32.277992 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 14:51:32.277992 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 14:51:32.277992 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 14:51:32.277992 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 14:51:32.277992 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 14:51:32.277992 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 14:51:32.277992 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 14:51:32.277992 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 14:51:32.277992 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 14:51:32.277992 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 14:51:32.279398 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 14:51:32.279398 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 14:51:32.279398 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 14:51:32.279398 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 14:51:32.279398 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1075807401 could not be found. Nov 02 14:51:32.279398 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:51:32.279398 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:51:32.279398 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:51:32.279398 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:51:32.279398 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:51:32.279398 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:51:32.279398 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:51:32.279398 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:51:32.279398 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 14:51:32.279398 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 14:51:32.279398 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:51:32.279398 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:51:32.279398 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Nov 02 14:51:32.279398 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:51:32.279398 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1075807401 could not be found. Nov 02 14:51:32.280914 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:51:32.280914 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:51:32.280914 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:51:32.280914 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:51:32.280914 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:51:32.280914 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:51:32.280914 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:51:32.280914 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:51:32.280914 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1075807401 could not be found. Nov 02 14:51:32.280914 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:51:32.280914 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-824a3bf6-1d5e-4e3c-af0d-20e830448b02 tempest-VolumesNegativeTest-11195648 tempest-VolumesNegativeTest-11195648-project] Returning 404 to user: Volume tempest-invalid-1075807401 could not be found. {{(pid=119658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:51:32.280914 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-824a3bf6-1d5e-4e3c-af0d-20e830448b02 tempest-VolumesNegativeTest-11195648 tempest-VolumesNegativeTest-11195648-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1075807401" status: 404 len: 99 microversion: 2.1 time: 0.038274 Nov 02 14:51:32.280914 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 501/1030] 10.222.0.30 () {58 vars in 1218 bytes} [Wed Nov 2 14:51:32 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1075807401 => generated 99 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 14:51:32.284944 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-cf7c6488-125e-4adb-ae24-e0753cdaab78 tempest-VolumesNegativeTest-11195648 tempest-VolumesNegativeTest-11195648-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003746 Nov 02 14:51:32.285460 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 530/1031] 10.222.0.30 () {58 vars in 1140 bytes} [Wed Nov 2 14:51:32 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Nov 02 14:51:32.293872 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-1ec1a016-6c36-4c7a-9b25-c0fd50b512b7 tempest-VolumesNegativeTest-11195648 tempest-VolumesNegativeTest-11195648-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003999 Nov 02 14:51:32.294363 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 502/1032] 10.222.0.30 () {58 vars in 1137 bytes} [Wed Nov 2 14:51:32 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 02 14:51:32.302788 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-69fbaf89-65e1-4cf8-9881-9199ca0d0993 tempest-VolumesNegativeTest-11195648 tempest-VolumesNegativeTest-11195648-project] Calling method '.version_select at 0x7fb24ec4f310>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:51:32.331219 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.wsgi [None req-69fbaf89-65e1-4cf8-9881-9199ca0d0993 tempest-VolumesNegativeTest-11195648 tempest-VolumesNegativeTest-11195648-project] HTTP exception thrown: Volume c3e609df-eae8-4421-9b5a-6bf965c39948 could not be found. Nov 02 14:51:32.333197 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-69fbaf89-65e1-4cf8-9881-9199ca0d0993 tempest-VolumesNegativeTest-11195648 tempest-VolumesNegativeTest-11195648-project] Request method failure captured: Nov 02 14:51:32.333197 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: request: DELETE /compute/v2.1/os-volumes/c3e609df-eae8-4421-9b5a-6bf965c39948 HTTP/1.1 Nov 02 14:51:32.333197 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Accept: application/json Nov 02 14:51:32.333197 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Accept-Encoding: identity Nov 02 14:51:32.333197 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Connection: close Nov 02 14:51:32.333197 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Content-Length: 0 Nov 02 14:51:32.333197 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Content-Type: application/json Nov 02 14:51:32.333197 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Host: 10.222.0.30 Nov 02 14:51:32.333197 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Openstack-System-Scope: None Nov 02 14:51:32.333197 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: User-Agent: python-urllib3/1.26.12 Nov 02 14:51:32.333197 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Auth-Token: gAAAAABjYoPzoFIse3f2oHm7RuZytndrGoF_ulsZzWAmFiE8c3C3aZBKuMamAkdS0Ui3Y8pPEhKVOfFO73hBk2yUfHNNqzzKF-zTHqfAroietSxLQSHNnH723U2MiukMu-uGo25_B-j9RXoP87fBAPLO3PdKaKZMk2OAhKdrEtdSNvBb1hnSxqY Nov 02 14:51:32.333197 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Domain-Id: None Nov 02 14:51:32.333197 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Domain-Name: None Nov 02 14:51:32.333197 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Identity-Status: Confirmed Nov 02 14:51:32.333197 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Is-Admin-Project: True Nov 02 14:51:32.333197 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Domain-Id: default Nov 02 14:51:32.333197 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Domain-Name: Default Nov 02 14:51:32.333197 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Id: 9dfe7b7c29f342faa0862767eac362dd Nov 02 14:51:32.333197 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Name: tempest-VolumesNegativeTest-11195648 Nov 02 14:51:32.333197 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Role: reader,member Nov 02 14:51:32.333197 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Roles: reader,member Nov 02 14:51:32.334839 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9dfe7b7c29f342faa0862767eac362dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/9dfe7b7c29f342faa0862767eac362dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9dfe7b7c29f342faa0862767eac362dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_9dfe7b7c29f342faa0862767eac362dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:51:32.334839 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant: tempest-VolumesNegativeTest-11195648 Nov 02 14:51:32.334839 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant-Id: 9dfe7b7c29f342faa0862767eac362dd Nov 02 14:51:32.334839 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant-Name: tempest-VolumesNegativeTest-11195648 Nov 02 14:51:32.334839 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User: tempest-VolumesNegativeTest-11195648-project Nov 02 14:51:32.334839 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Domain-Id: default Nov 02 14:51:32.334839 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Domain-Name: Default Nov 02 14:51:32.334839 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Id: 46cc19d4447d4440a18a716e6f1662fa Nov 02 14:51:32.334839 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Name: tempest-VolumesNegativeTest-11195648-project Nov 02 14:51:32.334839 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: method: Nov 02 14:51:32.334839 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: exception: Volume c3e609df-eae8-4421-9b5a-6bf965c39948 could not be found. Nov 02 14:51:32.334839 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: action_args: {'id': 'c3e609df-eae8-4421-9b5a-6bf965c39948'} Nov 02 14:51:32.334839 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:51:32.335898 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:51:32.335898 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 14:51:32.335898 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 14:51:32.335898 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 14:51:32.335898 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 14:51:32.335898 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 14:51:32.335898 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 14:51:32.335898 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 14:51:32.335898 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 14:51:32.335898 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 14:51:32.335898 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 14:51:32.335898 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 14:51:32.335898 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 14:51:32.335898 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 14:51:32.335898 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 14:51:32.335898 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c3e609df-eae8-4421-9b5a-6bf965c39948 could not be found. (HTTP 404) (Request-ID: req-7b60c1a8-b8c0-49df-ba1d-844c3a081bc5) Nov 02 14:51:32.335898 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:51:32.335898 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:51:32.335898 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:51:32.337360 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:51:32.337360 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Nov 02 14:51:32.337360 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Nov 02 14:51:32.337360 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 14:51:32.337360 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 14:51:32.337360 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 14:51:32.337360 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 14:51:32.337360 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 14:51:32.337360 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 14:51:32.337360 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 14:51:32.337360 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 14:51:32.337360 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 14:51:32.337360 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 14:51:32.337360 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 14:51:32.337360 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 14:51:32.337360 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 14:51:32.337360 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 14:51:32.337360 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 14:51:32.337360 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 14:51:32.340317 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 14:51:32.340317 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 14:51:32.340317 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 14:51:32.340317 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 14:51:32.340317 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c3e609df-eae8-4421-9b5a-6bf965c39948 could not be found. Nov 02 14:51:32.340317 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:51:32.340317 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:51:32.340317 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:51:32.340317 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:51:32.340317 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:51:32.340317 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:51:32.340317 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:51:32.340317 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:51:32.340317 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 14:51:32.340317 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 14:51:32.340317 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:51:32.340317 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:51:32.340317 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Nov 02 14:51:32.340317 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:51:32.341798 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c3e609df-eae8-4421-9b5a-6bf965c39948 could not be found. Nov 02 14:51:32.341798 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:51:32.341798 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:51:32.341798 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:51:32.341798 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:51:32.341798 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:51:32.341798 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:51:32.341798 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:51:32.341798 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:51:32.341798 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c3e609df-eae8-4421-9b5a-6bf965c39948 could not be found. Nov 02 14:51:32.341798 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:51:32.341798 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-69fbaf89-65e1-4cf8-9881-9199ca0d0993 tempest-VolumesNegativeTest-11195648 tempest-VolumesNegativeTest-11195648-project] Returning 404 to user: Volume c3e609df-eae8-4421-9b5a-6bf965c39948 could not be found. {{(pid=119659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:51:32.341798 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-69fbaf89-65e1-4cf8-9881-9199ca0d0993 tempest-VolumesNegativeTest-11195648 tempest-VolumesNegativeTest-11195648-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/c3e609df-eae8-4421-9b5a-6bf965c39948" status: 404 len: 109 microversion: 2.1 time: 0.035542 Nov 02 14:51:32.341798 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 531/1033] 10.222.0.30 () {58 vars in 1248 bytes} [Wed Nov 2 14:51:32 2022] DELETE /compute/v2.1/os-volumes/c3e609df-eae8-4421-9b5a-6bf965c39948 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:51:32.344340 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-f150f197-6977-438f-9c6d-d4f1e186e67b tempest-VolumesNegativeTest-11195648 tempest-VolumesNegativeTest-11195648-project] Calling method '.version_select at 0x7fb24ee7e1f0>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:51:32.372177 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.wsgi [None req-f150f197-6977-438f-9c6d-d4f1e186e67b tempest-VolumesNegativeTest-11195648 tempest-VolumesNegativeTest-11195648-project] HTTP exception thrown: Volume da85ee4d-4a50-43a4-8a8e-871ccc93b5ad could not be found. Nov 02 14:51:32.374171 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-f150f197-6977-438f-9c6d-d4f1e186e67b tempest-VolumesNegativeTest-11195648 tempest-VolumesNegativeTest-11195648-project] Request method failure captured: Nov 02 14:51:32.374171 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: request: GET /compute/v2.1/os-volumes/da85ee4d-4a50-43a4-8a8e-871ccc93b5ad HTTP/1.1 Nov 02 14:51:32.374171 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Accept: application/json Nov 02 14:51:32.374171 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Accept-Encoding: identity Nov 02 14:51:32.374171 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Connection: close Nov 02 14:51:32.374171 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Content-Length: 0 Nov 02 14:51:32.374171 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Content-Type: application/json Nov 02 14:51:32.374171 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Host: 10.222.0.30 Nov 02 14:51:32.374171 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Openstack-System-Scope: None Nov 02 14:51:32.374171 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: User-Agent: python-urllib3/1.26.12 Nov 02 14:51:32.374171 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Auth-Token: gAAAAABjYoPzoFIse3f2oHm7RuZytndrGoF_ulsZzWAmFiE8c3C3aZBKuMamAkdS0Ui3Y8pPEhKVOfFO73hBk2yUfHNNqzzKF-zTHqfAroietSxLQSHNnH723U2MiukMu-uGo25_B-j9RXoP87fBAPLO3PdKaKZMk2OAhKdrEtdSNvBb1hnSxqY Nov 02 14:51:32.374171 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Domain-Id: None Nov 02 14:51:32.374171 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Domain-Name: None Nov 02 14:51:32.374171 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Identity-Status: Confirmed Nov 02 14:51:32.374171 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Is-Admin-Project: True Nov 02 14:51:32.374171 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Domain-Id: default Nov 02 14:51:32.374171 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Domain-Name: Default Nov 02 14:51:32.374171 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Id: 9dfe7b7c29f342faa0862767eac362dd Nov 02 14:51:32.374171 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Name: tempest-VolumesNegativeTest-11195648 Nov 02 14:51:32.374171 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Role: reader,member Nov 02 14:51:32.374171 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Roles: reader,member Nov 02 14:51:32.375804 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9dfe7b7c29f342faa0862767eac362dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/9dfe7b7c29f342faa0862767eac362dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9dfe7b7c29f342faa0862767eac362dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_9dfe7b7c29f342faa0862767eac362dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:51:32.375804 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant: tempest-VolumesNegativeTest-11195648 Nov 02 14:51:32.375804 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant-Id: 9dfe7b7c29f342faa0862767eac362dd Nov 02 14:51:32.375804 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant-Name: tempest-VolumesNegativeTest-11195648 Nov 02 14:51:32.375804 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User: tempest-VolumesNegativeTest-11195648-project Nov 02 14:51:32.375804 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Domain-Id: default Nov 02 14:51:32.375804 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Domain-Name: Default Nov 02 14:51:32.375804 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Id: 46cc19d4447d4440a18a716e6f1662fa Nov 02 14:51:32.375804 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Name: tempest-VolumesNegativeTest-11195648-project Nov 02 14:51:32.375804 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: method: Nov 02 14:51:32.375804 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: exception: Volume da85ee4d-4a50-43a4-8a8e-871ccc93b5ad could not be found. Nov 02 14:51:32.375804 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: action_args: {'id': 'da85ee4d-4a50-43a4-8a8e-871ccc93b5ad'} Nov 02 14:51:32.375804 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:51:32.376824 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:51:32.376824 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 14:51:32.376824 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 14:51:32.376824 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 14:51:32.376824 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 14:51:32.376824 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 14:51:32.376824 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 14:51:32.376824 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 14:51:32.376824 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 14:51:32.376824 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 14:51:32.376824 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 14:51:32.376824 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 14:51:32.376824 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 14:51:32.376824 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 14:51:32.376824 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 14:51:32.376824 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume da85ee4d-4a50-43a4-8a8e-871ccc93b5ad could not be found. (HTTP 404) (Request-ID: req-172989ef-598d-478e-822e-13209eb1c61d) Nov 02 14:51:32.376824 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:51:32.376824 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:51:32.376824 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:51:32.378306 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:51:32.378306 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Nov 02 14:51:32.378306 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Nov 02 14:51:32.378306 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 14:51:32.378306 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 14:51:32.378306 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 14:51:32.378306 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 14:51:32.378306 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 14:51:32.378306 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 14:51:32.378306 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 14:51:32.378306 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 14:51:32.378306 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 14:51:32.378306 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 14:51:32.378306 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 14:51:32.378306 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 14:51:32.378306 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 14:51:32.378306 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 14:51:32.378306 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 14:51:32.378306 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 14:51:32.379620 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 14:51:32.379620 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 14:51:32.379620 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 14:51:32.379620 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 14:51:32.379620 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume da85ee4d-4a50-43a4-8a8e-871ccc93b5ad could not be found. Nov 02 14:51:32.379620 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:51:32.379620 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:51:32.379620 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:51:32.379620 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:51:32.379620 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:51:32.379620 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:51:32.379620 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:51:32.379620 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:51:32.379620 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 14:51:32.379620 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 14:51:32.379620 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:51:32.379620 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:51:32.379620 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Nov 02 14:51:32.379620 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:51:32.381087 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume da85ee4d-4a50-43a4-8a8e-871ccc93b5ad could not be found. Nov 02 14:51:32.381087 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:51:32.381087 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:51:32.381087 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:51:32.381087 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:51:32.381087 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:51:32.381087 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:51:32.381087 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:51:32.381087 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:51:32.381087 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume da85ee4d-4a50-43a4-8a8e-871ccc93b5ad could not be found. Nov 02 14:51:32.381087 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:51:32.381087 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-f150f197-6977-438f-9c6d-d4f1e186e67b tempest-VolumesNegativeTest-11195648 tempest-VolumesNegativeTest-11195648-project] Returning 404 to user: Volume da85ee4d-4a50-43a4-8a8e-871ccc93b5ad could not be found. {{(pid=119658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:51:32.381087 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-f150f197-6977-438f-9c6d-d4f1e186e67b tempest-VolumesNegativeTest-11195648 tempest-VolumesNegativeTest-11195648-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/da85ee4d-4a50-43a4-8a8e-871ccc93b5ad" status: 404 len: 109 microversion: 2.1 time: 0.035169 Nov 02 14:51:32.381087 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 503/1034] 10.222.0.30 () {58 vars in 1245 bytes} [Wed Nov 2 14:51:32 2022] GET /compute/v2.1/os-volumes/da85ee4d-4a50-43a4-8a8e-871ccc93b5ad => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 14:51:54.120933 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:51:54.120933 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:51:54.121712 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:51:54.121712 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:51:54.123309 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-b9517911-2c30-4bf0-aa99-cee8e4decb47 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:51:54.123816 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-b9517911-2c30-4bf0-aa99-cee8e4decb47 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: 64ac4c3a-dc23-44e3-a2aa-89a6922a9279] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:51:54.140619 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b9517911-2c30-4bf0-aa99-cee8e4decb47 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:54.141145 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b9517911-2c30-4bf0-aa99-cee8e4decb47 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:54.141582 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b9517911-2c30-4bf0-aa99-cee8e4decb47 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:54.142286 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b9517911-2c30-4bf0-aa99-cee8e4decb47 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:54.142737 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b9517911-2c30-4bf0-aa99-cee8e4decb47 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:54.143167 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b9517911-2c30-4bf0-aa99-cee8e4decb47 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:54.179552 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-b9517911-2c30-4bf0-aa99-cee8e4decb47 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: 64ac4c3a-dc23-44e3-a2aa-89a6922a9279] Going to try to terminate instance {{(pid=119659) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:51:54.344358 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [req-93f539d5-f949-43b4-aedb-5b941f17b306 req-71715439-3803-4215-980d-68a458ed60e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64ac4c3a-dc23-44e3-a2aa-89a6922a9279", "tag": "8611187e-9072-476d-847c-6718440138c0"}]} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:51:54.357083 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-93f539d5-f949-43b4-aedb-5b941f17b306 req-71715439-3803-4215-980d-68a458ed60e6 service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:54.358082 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-93f539d5-f949-43b4-aedb-5b941f17b306 req-71715439-3803-4215-980d-68a458ed60e6 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:54.358818 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-93f539d5-f949-43b4-aedb-5b941f17b306 req-71715439-3803-4215-980d-68a458ed60e6 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:54.384536 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.compute.server_external_events [req-93f539d5-f949-43b4-aedb-5b941f17b306 req-71715439-3803-4215-980d-68a458ed60e6 service nova] Creating event network-changed:8611187e-9072-476d-847c-6718440138c0 for instance 64ac4c3a-dc23-44e3-a2aa-89a6922a9279 on hv-cinder-86236 Nov 02 14:51:54.390317 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [req-93f539d5-f949-43b4-aedb-5b941f17b306 req-71715439-3803-4215-980d-68a458ed60e6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.271611 Nov 02 14:51:54.390916 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 504/1035] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:51:54.560043 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-b9517911-2c30-4bf0-aa99-cee8e4decb47 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "DELETE /compute/v2.1/servers/64ac4c3a-dc23-44e3-a2aa-89a6922a9279" status: 204 len: 0 microversion: 2.1 time: 0.443937 Nov 02 14:51:54.561070 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 532/1036] 10.222.0.30 () {58 vars in 1239 bytes} [Wed Nov 2 14:51:54 2022] DELETE /compute/v2.1/servers/64ac4c3a-dc23-44e3-a2aa-89a6922a9279 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:51:54.585655 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-a65f831a-fdbb-4803-ae12-634a90629223 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:51:54.588064 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-a65f831a-fdbb-4803-ae12-634a90629223 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: 64ac4c3a-dc23-44e3-a2aa-89a6922a9279] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:51:54.607789 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a65f831a-fdbb-4803-ae12-634a90629223 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:54.608973 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a65f831a-fdbb-4803-ae12-634a90629223 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:54.609768 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a65f831a-fdbb-4803-ae12-634a90629223 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:54.610915 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a65f831a-fdbb-4803-ae12-634a90629223 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:54.611751 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a65f831a-fdbb-4803-ae12-634a90629223 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:54.612548 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a65f831a-fdbb-4803-ae12-634a90629223 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:54.790169 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-a65f831a-fdbb-4803-ae12-634a90629223 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:51:54.802510 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-a65f831a-fdbb-4803-ae12-634a90629223 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/64ac4c3a-dc23-44e3-a2aa-89a6922a9279" status: 200 len: 1578 microversion: 2.1 time: 0.236423 Nov 02 14:51:54.804499 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 505/1037] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:51:54 2022] GET /compute/v2.1/servers/64ac4c3a-dc23-44e3-a2aa-89a6922a9279 => generated 1578 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:51:55.829349 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-cef86369-7e97-4c32-9a78-5bff1e5ad79b tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:51:55.830077 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-cef86369-7e97-4c32-9a78-5bff1e5ad79b tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: 64ac4c3a-dc23-44e3-a2aa-89a6922a9279] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:51:55.838381 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-cef86369-7e97-4c32-9a78-5bff1e5ad79b tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:55.838891 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-cef86369-7e97-4c32-9a78-5bff1e5ad79b tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:55.839349 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-cef86369-7e97-4c32-9a78-5bff1e5ad79b tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:55.840234 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-cef86369-7e97-4c32-9a78-5bff1e5ad79b tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:55.840705 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-cef86369-7e97-4c32-9a78-5bff1e5ad79b tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:55.841168 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-cef86369-7e97-4c32-9a78-5bff1e5ad79b tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:56.024344 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-cef86369-7e97-4c32-9a78-5bff1e5ad79b tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:51:56.032627 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-cef86369-7e97-4c32-9a78-5bff1e5ad79b tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/64ac4c3a-dc23-44e3-a2aa-89a6922a9279" status: 200 len: 1578 microversion: 2.1 time: 0.208321 Nov 02 14:51:56.033401 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 533/1038] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:51:55 2022] GET /compute/v2.1/servers/64ac4c3a-dc23-44e3-a2aa-89a6922a9279 => generated 1578 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:51:56.809882 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [req-f008ef65-56f1-479c-b526-14bad2b8562a req-e016f634-0ca2-4752-b0b7-d55d6f94013d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64ac4c3a-dc23-44e3-a2aa-89a6922a9279", "name": "network-vif-deleted", "tag": "8611187e-9072-476d-847c-6718440138c0"}]} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:51:56.822157 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-f008ef65-56f1-479c-b526-14bad2b8562a req-e016f634-0ca2-4752-b0b7-d55d6f94013d service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:56.822504 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-f008ef65-56f1-479c-b526-14bad2b8562a req-e016f634-0ca2-4752-b0b7-d55d6f94013d service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:56.822942 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-f008ef65-56f1-479c-b526-14bad2b8562a req-e016f634-0ca2-4752-b0b7-d55d6f94013d service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:56.835182 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.compute.server_external_events [req-f008ef65-56f1-479c-b526-14bad2b8562a req-e016f634-0ca2-4752-b0b7-d55d6f94013d service nova] Creating event network-vif-deleted:8611187e-9072-476d-847c-6718440138c0 for instance 64ac4c3a-dc23-44e3-a2aa-89a6922a9279 on hv-cinder-86236 Nov 02 14:51:56.840591 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [req-f008ef65-56f1-479c-b526-14bad2b8562a req-e016f634-0ca2-4752-b0b7-d55d6f94013d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034893 Nov 02 14:51:56.842627 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 506/1039] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:51:57.056161 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-aa0ccacd-4fe7-4dd5-a05c-b3dbf5c01e7b tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:51:57.056804 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-aa0ccacd-4fe7-4dd5-a05c-b3dbf5c01e7b tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: 64ac4c3a-dc23-44e3-a2aa-89a6922a9279] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:51:57.063366 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-aa0ccacd-4fe7-4dd5-a05c-b3dbf5c01e7b tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:57.063848 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-aa0ccacd-4fe7-4dd5-a05c-b3dbf5c01e7b tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:57.064285 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-aa0ccacd-4fe7-4dd5-a05c-b3dbf5c01e7b tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:57.065069 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-aa0ccacd-4fe7-4dd5-a05c-b3dbf5c01e7b tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:57.065553 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-aa0ccacd-4fe7-4dd5-a05c-b3dbf5c01e7b tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:57.065979 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-aa0ccacd-4fe7-4dd5-a05c-b3dbf5c01e7b tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:57.132871 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-aa0ccacd-4fe7-4dd5-a05c-b3dbf5c01e7b tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:51:57.141586 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-aa0ccacd-4fe7-4dd5-a05c-b3dbf5c01e7b tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/64ac4c3a-dc23-44e3-a2aa-89a6922a9279" status: 200 len: 1225 microversion: 2.1 time: 0.089230 Nov 02 14:51:57.142179 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 534/1040] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:51:57 2022] GET /compute/v2.1/servers/64ac4c3a-dc23-44e3-a2aa-89a6922a9279 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:51:58.166173 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-131b887c-d7e7-45cb-b98f-ff4650f5fed6 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:51:58.166871 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-131b887c-d7e7-45cb-b98f-ff4650f5fed6 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: 64ac4c3a-dc23-44e3-a2aa-89a6922a9279] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:51:58.173648 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-131b887c-d7e7-45cb-b98f-ff4650f5fed6 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:58.175227 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-131b887c-d7e7-45cb-b98f-ff4650f5fed6 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:58.175227 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-131b887c-d7e7-45cb-b98f-ff4650f5fed6 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:58.175227 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-131b887c-d7e7-45cb-b98f-ff4650f5fed6 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:58.175670 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-131b887c-d7e7-45cb-b98f-ff4650f5fed6 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:58.176097 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-131b887c-d7e7-45cb-b98f-ff4650f5fed6 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:58.209354 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-131b887c-d7e7-45cb-b98f-ff4650f5fed6 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:58.209760 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-131b887c-d7e7-45cb-b98f-ff4650f5fed6 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:58.210207 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-131b887c-d7e7-45cb-b98f-ff4650f5fed6 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:58.210663 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.objects.instance [None req-131b887c-d7e7-45cb-b98f-ff4650f5fed6 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lazy-loading 'fault' on Instance uuid 64ac4c3a-dc23-44e3-a2aa-89a6922a9279 {{(pid=119658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:51:58.257696 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-131b887c-d7e7-45cb-b98f-ff4650f5fed6 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:51:58.266701 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-131b887c-d7e7-45cb-b98f-ff4650f5fed6 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/64ac4c3a-dc23-44e3-a2aa-89a6922a9279" status: 200 len: 1230 microversion: 2.1 time: 0.105294 Nov 02 14:51:58.272770 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 507/1041] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:51:58 2022] GET /compute/v2.1/servers/64ac4c3a-dc23-44e3-a2aa-89a6922a9279 => generated 1230 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:51:59.290809 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-6698ee70-e54d-400a-98e8-c017fcfe64c7 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:51:59.291538 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-6698ee70-e54d-400a-98e8-c017fcfe64c7 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: 64ac4c3a-dc23-44e3-a2aa-89a6922a9279] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:51:59.298176 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6698ee70-e54d-400a-98e8-c017fcfe64c7 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:59.298661 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6698ee70-e54d-400a-98e8-c017fcfe64c7 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:59.299095 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6698ee70-e54d-400a-98e8-c017fcfe64c7 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:59.299794 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6698ee70-e54d-400a-98e8-c017fcfe64c7 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:59.300268 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6698ee70-e54d-400a-98e8-c017fcfe64c7 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:59.300796 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6698ee70-e54d-400a-98e8-c017fcfe64c7 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:59.315002 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.wsgi [None req-6698ee70-e54d-400a-98e8-c017fcfe64c7 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] HTTP exception thrown: Instance 64ac4c3a-dc23-44e3-a2aa-89a6922a9279 could not be found. Nov 02 14:51:59.316651 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-6698ee70-e54d-400a-98e8-c017fcfe64c7 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Request method failure captured: Nov 02 14:51:59.316651 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: request: GET /compute/v2.1/servers/64ac4c3a-dc23-44e3-a2aa-89a6922a9279 HTTP/1.1 Nov 02 14:51:59.316651 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Accept: application/json Nov 02 14:51:59.316651 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Accept-Encoding: identity Nov 02 14:51:59.316651 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Connection: close Nov 02 14:51:59.316651 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Content-Length: 0 Nov 02 14:51:59.316651 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Content-Type: application/json Nov 02 14:51:59.316651 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Host: 10.222.0.30 Nov 02 14:51:59.316651 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Openstack-System-Scope: None Nov 02 14:51:59.316651 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: User-Agent: python-urllib3/1.26.12 Nov 02 14:51:59.316651 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Auth-Token: gAAAAABjYoJU8mRtfklw2BqB8rxFPb9k4q0WLzod3pzKmTOxEu-Rawboc6-18-tFhoQU0IBY1PalXTbgXqEb5svZEk4EM19nsBvNwEJ9rKdAGE2eZMXT00nXhJe0Nq67h_qpM4Csttau-wzu2afBMob496zDR_AX_Vw_7hryB10KQXmXtCuC5P8 Nov 02 14:51:59.316651 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Domain-Id: None Nov 02 14:51:59.316651 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Domain-Name: None Nov 02 14:51:59.316651 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Identity-Status: Confirmed Nov 02 14:51:59.316651 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Is-Admin-Project: True Nov 02 14:51:59.316651 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Domain-Id: default Nov 02 14:51:59.316651 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Domain-Name: Default Nov 02 14:51:59.316651 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Id: 990b7e753ad1450489668d0ca151736e Nov 02 14:51:59.316651 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Name: tempest-TestVolumeBootPattern-1105129780 Nov 02 14:51:59.316651 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Role: reader,member Nov 02 14:51:59.316651 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Roles: reader,member Nov 02 14:51:59.318444 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/990b7e753ad1450489668d0ca151736e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/990b7e753ad1450489668d0ca151736e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/990b7e753ad1450489668d0ca151736e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_990b7e753ad1450489668d0ca151736e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:51:59.318444 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant: tempest-TestVolumeBootPattern-1105129780 Nov 02 14:51:59.318444 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant-Id: 990b7e753ad1450489668d0ca151736e Nov 02 14:51:59.318444 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant-Name: tempest-TestVolumeBootPattern-1105129780 Nov 02 14:51:59.318444 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User: tempest-TestVolumeBootPattern-1105129780-project Nov 02 14:51:59.318444 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Domain-Id: default Nov 02 14:51:59.318444 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Domain-Name: Default Nov 02 14:51:59.318444 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Id: 6f0516ac4c6648f9b208a89e174da3a3 Nov 02 14:51:59.318444 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Name: tempest-TestVolumeBootPattern-1105129780-project Nov 02 14:51:59.318444 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: method: > Nov 02 14:51:59.318444 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: exception: Instance 64ac4c3a-dc23-44e3-a2aa-89a6922a9279 could not be found. Nov 02 14:51:59.318444 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: action_args: {'id': '64ac4c3a-dc23-44e3-a2aa-89a6922a9279'} Nov 02 14:51:59.319406 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:51:59.319406 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:51:59.319406 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:51:59.319406 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:51:59.319406 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:51:59.319406 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:51:59.319406 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:51:59.319406 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:51:59.319406 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:51:59.319406 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:51:59.319406 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64ac4c3a-dc23-44e3-a2aa-89a6922a9279 could not be found. Nov 02 14:51:59.319406 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:51:59.319406 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:51:59.319406 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:51:59.319406 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:51:59.319406 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:51:59.319406 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:51:59.319406 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:51:59.319406 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:51:59.319406 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:51:59.321065 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:51:59.321065 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:51:59.321065 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:51:59.321065 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:51:59.321065 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:51:59.321065 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:51:59.321065 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:51:59.321065 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64ac4c3a-dc23-44e3-a2aa-89a6922a9279 could not be found. Nov 02 14:51:59.321065 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:51:59.321065 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:51:59.321065 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:51:59.321065 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:51:59.321065 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:51:59.321065 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:51:59.321065 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:51:59.321065 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:51:59.321065 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64ac4c3a-dc23-44e3-a2aa-89a6922a9279 could not be found. Nov 02 14:51:59.321065 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:51:59.332720 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-6698ee70-e54d-400a-98e8-c017fcfe64c7 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Returning 404 to user: Instance 64ac4c3a-dc23-44e3-a2aa-89a6922a9279 could not be found. {{(pid=119659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:51:59.332720 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-6698ee70-e54d-400a-98e8-c017fcfe64c7 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/64ac4c3a-dc23-44e3-a2aa-89a6922a9279" status: 404 len: 111 microversion: 2.1 time: 0.031778 Nov 02 14:51:59.332720 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 535/1042] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:51:59 2022] GET /compute/v2.1/servers/64ac4c3a-dc23-44e3-a2aa-89a6922a9279 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:52:03.157260 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-fe414a82-2bc6-4da8-98f9-7f1d6e011cf3 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:52:03.159786 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [req-04c79262-9dd9-45f8-937c-5d701ad6bcab req-2a1b127c-2d8e-41f4-b494-a6111b0b7c3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e4576f1-35ce-4081-a2f1-e8e324a1c677", "tag": "c8c7d645-c149-4b30-8fb6-474b94827b54"}]} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:52:03.160580 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-fe414a82-2bc6-4da8-98f9-7f1d6e011cf3 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: 6e4576f1-35ce-4081-a2f1-e8e324a1c677] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:52:03.167951 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-fe414a82-2bc6-4da8-98f9-7f1d6e011cf3 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:03.168611 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-fe414a82-2bc6-4da8-98f9-7f1d6e011cf3 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:03.169390 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-fe414a82-2bc6-4da8-98f9-7f1d6e011cf3 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:03.170313 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-fe414a82-2bc6-4da8-98f9-7f1d6e011cf3 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:03.170901 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-fe414a82-2bc6-4da8-98f9-7f1d6e011cf3 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:03.171639 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-fe414a82-2bc6-4da8-98f9-7f1d6e011cf3 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:03.173798 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-04c79262-9dd9-45f8-937c-5d701ad6bcab req-2a1b127c-2d8e-41f4-b494-a6111b0b7c3e service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:03.174602 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-04c79262-9dd9-45f8-937c-5d701ad6bcab req-2a1b127c-2d8e-41f4-b494-a6111b0b7c3e service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:03.175423 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-04c79262-9dd9-45f8-937c-5d701ad6bcab req-2a1b127c-2d8e-41f4-b494-a6111b0b7c3e service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:03.197845 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.compute.server_external_events [req-04c79262-9dd9-45f8-937c-5d701ad6bcab req-2a1b127c-2d8e-41f4-b494-a6111b0b7c3e service nova] Creating event network-changed:c8c7d645-c149-4b30-8fb6-474b94827b54 for instance 6e4576f1-35ce-4081-a2f1-e8e324a1c677 on hv-cinder-86236 Nov 02 14:52:03.204583 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-fe414a82-2bc6-4da8-98f9-7f1d6e011cf3 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: 6e4576f1-35ce-4081-a2f1-e8e324a1c677] Going to try to terminate instance {{(pid=119658) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:52:03.205277 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [req-04c79262-9dd9-45f8-937c-5d701ad6bcab req-2a1b127c-2d8e-41f4-b494-a6111b0b7c3e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052084 Nov 02 14:52:03.206461 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 536/1043] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:52:03.570082 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-fe414a82-2bc6-4da8-98f9-7f1d6e011cf3 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6e4576f1-35ce-4081-a2f1-e8e324a1c677" status: 204 len: 0 microversion: 2.1 time: 0.417396 Nov 02 14:52:03.574132 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 508/1044] 10.222.0.30 () {58 vars in 1239 bytes} [Wed Nov 2 14:52:03 2022] DELETE /compute/v2.1/servers/6e4576f1-35ce-4081-a2f1-e8e324a1c677 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:52:03.582498 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-6dd7fcdf-40a2-4294-ad40-e081e0fe724f tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:52:03.583188 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-6dd7fcdf-40a2-4294-ad40-e081e0fe724f tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: 6e4576f1-35ce-4081-a2f1-e8e324a1c677] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:52:03.590032 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6dd7fcdf-40a2-4294-ad40-e081e0fe724f tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:03.590514 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6dd7fcdf-40a2-4294-ad40-e081e0fe724f tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:03.590944 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6dd7fcdf-40a2-4294-ad40-e081e0fe724f tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:03.591633 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6dd7fcdf-40a2-4294-ad40-e081e0fe724f tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:03.592316 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6dd7fcdf-40a2-4294-ad40-e081e0fe724f tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:03.592737 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6dd7fcdf-40a2-4294-ad40-e081e0fe724f tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:03.736670 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-6dd7fcdf-40a2-4294-ad40-e081e0fe724f tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:52:03.745676 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-6dd7fcdf-40a2-4294-ad40-e081e0fe724f tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/6e4576f1-35ce-4081-a2f1-e8e324a1c677" status: 200 len: 1577 microversion: 2.1 time: 0.167179 Nov 02 14:52:03.746465 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 537/1045] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:52:03 2022] GET /compute/v2.1/servers/6e4576f1-35ce-4081-a2f1-e8e324a1c677 => generated 1577 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:52:04.772006 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-3d11d503-d353-4966-82a6-391977caa190 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:52:04.772738 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-3d11d503-d353-4966-82a6-391977caa190 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: 6e4576f1-35ce-4081-a2f1-e8e324a1c677] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:52:04.779840 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3d11d503-d353-4966-82a6-391977caa190 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:04.780388 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3d11d503-d353-4966-82a6-391977caa190 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:04.780824 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3d11d503-d353-4966-82a6-391977caa190 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:04.781588 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3d11d503-d353-4966-82a6-391977caa190 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:04.782042 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3d11d503-d353-4966-82a6-391977caa190 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:04.782476 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3d11d503-d353-4966-82a6-391977caa190 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:04.935352 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-3d11d503-d353-4966-82a6-391977caa190 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:52:04.944188 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-3d11d503-d353-4966-82a6-391977caa190 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/6e4576f1-35ce-4081-a2f1-e8e324a1c677" status: 200 len: 1577 microversion: 2.1 time: 0.176450 Nov 02 14:52:04.944878 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 509/1046] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:52:04 2022] GET /compute/v2.1/servers/6e4576f1-35ce-4081-a2f1-e8e324a1c677 => generated 1577 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:52:05.851235 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [req-919ac3d9-59d9-40a4-9623-4ee2dcf3a494 req-d09997db-9196-41a8-99de-045ab2ee0860 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e4576f1-35ce-4081-a2f1-e8e324a1c677", "name": "network-vif-deleted", "tag": "c8c7d645-c149-4b30-8fb6-474b94827b54"}]} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:52:05.862224 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-919ac3d9-59d9-40a4-9623-4ee2dcf3a494 req-d09997db-9196-41a8-99de-045ab2ee0860 service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:05.862700 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-919ac3d9-59d9-40a4-9623-4ee2dcf3a494 req-d09997db-9196-41a8-99de-045ab2ee0860 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:05.866390 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-919ac3d9-59d9-40a4-9623-4ee2dcf3a494 req-d09997db-9196-41a8-99de-045ab2ee0860 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:05.874958 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.compute.server_external_events [req-919ac3d9-59d9-40a4-9623-4ee2dcf3a494 req-d09997db-9196-41a8-99de-045ab2ee0860 service nova] Creating event network-vif-deleted:c8c7d645-c149-4b30-8fb6-474b94827b54 for instance 6e4576f1-35ce-4081-a2f1-e8e324a1c677 on hv-cinder-86236 Nov 02 14:52:05.879757 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [req-919ac3d9-59d9-40a4-9623-4ee2dcf3a494 req-d09997db-9196-41a8-99de-045ab2ee0860 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032453 Nov 02 14:52:05.880341 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 538/1047] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:52:05.977181 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-6548f930-49b7-469c-a2ea-8821c3fe023f tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:52:05.977181 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-6548f930-49b7-469c-a2ea-8821c3fe023f tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: 6e4576f1-35ce-4081-a2f1-e8e324a1c677] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:52:05.982735 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6548f930-49b7-469c-a2ea-8821c3fe023f tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:05.983448 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6548f930-49b7-469c-a2ea-8821c3fe023f tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:05.983900 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6548f930-49b7-469c-a2ea-8821c3fe023f tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:05.984617 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6548f930-49b7-469c-a2ea-8821c3fe023f tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:05.985110 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6548f930-49b7-469c-a2ea-8821c3fe023f tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:05.985538 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6548f930-49b7-469c-a2ea-8821c3fe023f tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:06.057280 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-6548f930-49b7-469c-a2ea-8821c3fe023f tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:52:06.066861 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-6548f930-49b7-469c-a2ea-8821c3fe023f tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/6e4576f1-35ce-4081-a2f1-e8e324a1c677" status: 200 len: 1391 microversion: 2.1 time: 0.100585 Nov 02 14:52:06.067386 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 510/1048] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:52:05 2022] GET /compute/v2.1/servers/6e4576f1-35ce-4081-a2f1-e8e324a1c677 => generated 1391 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:52:07.090832 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-9e382af0-7512-4642-a5df-3420a581eebf tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:52:07.091527 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-9e382af0-7512-4642-a5df-3420a581eebf tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: 6e4576f1-35ce-4081-a2f1-e8e324a1c677] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:52:07.097674 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9e382af0-7512-4642-a5df-3420a581eebf tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:07.098162 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9e382af0-7512-4642-a5df-3420a581eebf tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:07.098595 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9e382af0-7512-4642-a5df-3420a581eebf tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:07.099289 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9e382af0-7512-4642-a5df-3420a581eebf tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:07.099735 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9e382af0-7512-4642-a5df-3420a581eebf tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:07.100162 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9e382af0-7512-4642-a5df-3420a581eebf tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:07.133983 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9e382af0-7512-4642-a5df-3420a581eebf tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:07.134467 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9e382af0-7512-4642-a5df-3420a581eebf tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:07.134900 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-9e382af0-7512-4642-a5df-3420a581eebf tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:07.135369 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.objects.instance [None req-9e382af0-7512-4642-a5df-3420a581eebf tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lazy-loading 'fault' on Instance uuid 6e4576f1-35ce-4081-a2f1-e8e324a1c677 {{(pid=119659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:52:07.182142 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-9e382af0-7512-4642-a5df-3420a581eebf tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0516ac4c6648f9b208a89e174da3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990b7e753ad1450489668d0ca151736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:52:07.190031 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-9e382af0-7512-4642-a5df-3420a581eebf tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/6e4576f1-35ce-4081-a2f1-e8e324a1c677" status: 200 len: 1230 microversion: 2.1 time: 0.103985 Nov 02 14:52:07.200548 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 539/1049] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:52:07 2022] GET /compute/v2.1/servers/6e4576f1-35ce-4081-a2f1-e8e324a1c677 => generated 1230 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:52:08.224741 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-ec0b4a5c-b948-47b4-aff1-032000e22f43 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:52:08.225366 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-ec0b4a5c-b948-47b4-aff1-032000e22f43 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: 6e4576f1-35ce-4081-a2f1-e8e324a1c677] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:52:08.232513 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ec0b4a5c-b948-47b4-aff1-032000e22f43 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:08.233022 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ec0b4a5c-b948-47b4-aff1-032000e22f43 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:08.233481 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ec0b4a5c-b948-47b4-aff1-032000e22f43 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:08.234195 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ec0b4a5c-b948-47b4-aff1-032000e22f43 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:08.234654 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ec0b4a5c-b948-47b4-aff1-032000e22f43 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:08.235084 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ec0b4a5c-b948-47b4-aff1-032000e22f43 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:08.250020 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.wsgi [None req-ec0b4a5c-b948-47b4-aff1-032000e22f43 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] HTTP exception thrown: Instance 6e4576f1-35ce-4081-a2f1-e8e324a1c677 could not be found. Nov 02 14:52:08.251707 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-ec0b4a5c-b948-47b4-aff1-032000e22f43 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Request method failure captured: Nov 02 14:52:08.251707 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: request: GET /compute/v2.1/servers/6e4576f1-35ce-4081-a2f1-e8e324a1c677 HTTP/1.1 Nov 02 14:52:08.251707 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Accept: application/json Nov 02 14:52:08.251707 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Accept-Encoding: identity Nov 02 14:52:08.251707 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Connection: close Nov 02 14:52:08.251707 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Content-Length: 0 Nov 02 14:52:08.251707 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Content-Type: application/json Nov 02 14:52:08.251707 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Host: 10.222.0.30 Nov 02 14:52:08.251707 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Openstack-System-Scope: None Nov 02 14:52:08.251707 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: User-Agent: python-urllib3/1.26.12 Nov 02 14:52:08.251707 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Auth-Token: gAAAAABjYoJU8mRtfklw2BqB8rxFPb9k4q0WLzod3pzKmTOxEu-Rawboc6-18-tFhoQU0IBY1PalXTbgXqEb5svZEk4EM19nsBvNwEJ9rKdAGE2eZMXT00nXhJe0Nq67h_qpM4Csttau-wzu2afBMob496zDR_AX_Vw_7hryB10KQXmXtCuC5P8 Nov 02 14:52:08.251707 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Domain-Id: None Nov 02 14:52:08.251707 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Domain-Name: None Nov 02 14:52:08.251707 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Identity-Status: Confirmed Nov 02 14:52:08.251707 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Is-Admin-Project: True Nov 02 14:52:08.251707 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Domain-Id: default Nov 02 14:52:08.251707 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Domain-Name: Default Nov 02 14:52:08.251707 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Id: 990b7e753ad1450489668d0ca151736e Nov 02 14:52:08.251707 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Name: tempest-TestVolumeBootPattern-1105129780 Nov 02 14:52:08.251707 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Role: reader,member Nov 02 14:52:08.251707 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Roles: reader,member Nov 02 14:52:08.253432 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/990b7e753ad1450489668d0ca151736e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/990b7e753ad1450489668d0ca151736e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/990b7e753ad1450489668d0ca151736e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_990b7e753ad1450489668d0ca151736e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:52:08.253432 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant: tempest-TestVolumeBootPattern-1105129780 Nov 02 14:52:08.253432 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant-Id: 990b7e753ad1450489668d0ca151736e Nov 02 14:52:08.253432 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant-Name: tempest-TestVolumeBootPattern-1105129780 Nov 02 14:52:08.253432 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User: tempest-TestVolumeBootPattern-1105129780-project Nov 02 14:52:08.253432 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Domain-Id: default Nov 02 14:52:08.253432 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Domain-Name: Default Nov 02 14:52:08.253432 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Id: 6f0516ac4c6648f9b208a89e174da3a3 Nov 02 14:52:08.253432 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Name: tempest-TestVolumeBootPattern-1105129780-project Nov 02 14:52:08.253432 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: method: > Nov 02 14:52:08.253432 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: exception: Instance 6e4576f1-35ce-4081-a2f1-e8e324a1c677 could not be found. Nov 02 14:52:08.253432 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: action_args: {'id': '6e4576f1-35ce-4081-a2f1-e8e324a1c677'} Nov 02 14:52:08.254358 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:52:08.254358 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:52:08.254358 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:52:08.254358 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:52:08.254358 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:52:08.254358 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:52:08.254358 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:52:08.254358 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:52:08.254358 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:52:08.254358 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:52:08.254358 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e4576f1-35ce-4081-a2f1-e8e324a1c677 could not be found. Nov 02 14:52:08.254358 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:52:08.254358 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:52:08.254358 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:52:08.254358 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:52:08.254358 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:52:08.254358 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:52:08.254358 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:52:08.254358 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:52:08.254358 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:52:08.255886 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:52:08.255886 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:52:08.255886 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:52:08.255886 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:52:08.255886 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:52:08.255886 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:52:08.255886 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:52:08.255886 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e4576f1-35ce-4081-a2f1-e8e324a1c677 could not be found. Nov 02 14:52:08.255886 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:52:08.255886 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:52:08.255886 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:52:08.255886 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:52:08.255886 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:52:08.255886 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:52:08.255886 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:52:08.255886 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:52:08.255886 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e4576f1-35ce-4081-a2f1-e8e324a1c677 could not be found. Nov 02 14:52:08.255886 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:52:08.262098 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-ec0b4a5c-b948-47b4-aff1-032000e22f43 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Returning 404 to user: Instance 6e4576f1-35ce-4081-a2f1-e8e324a1c677 could not be found. {{(pid=119658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:52:08.262098 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-ec0b4a5c-b948-47b4-aff1-032000e22f43 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/6e4576f1-35ce-4081-a2f1-e8e324a1c677" status: 404 len: 111 microversion: 2.1 time: 0.032274 Nov 02 14:52:08.262098 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 511/1050] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:52:08 2022] GET /compute/v2.1/servers/6e4576f1-35ce-4081-a2f1-e8e324a1c677 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:52:08.824541 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-c08a22af-890a-43d7-8c6d-6349f0b893a7 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:52:08.825120 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-c08a22af-890a-43d7-8c6d-6349f0b893a7 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: a70e0509-33cf-40a8-a0e2-a5da4317522c] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:52:08.831671 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c08a22af-890a-43d7-8c6d-6349f0b893a7 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:08.832220 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c08a22af-890a-43d7-8c6d-6349f0b893a7 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:08.832654 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c08a22af-890a-43d7-8c6d-6349f0b893a7 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:08.833372 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c08a22af-890a-43d7-8c6d-6349f0b893a7 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:08.833817 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c08a22af-890a-43d7-8c6d-6349f0b893a7 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:08.834247 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c08a22af-890a-43d7-8c6d-6349f0b893a7 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:08.848850 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.wsgi [None req-c08a22af-890a-43d7-8c6d-6349f0b893a7 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] HTTP exception thrown: Instance a70e0509-33cf-40a8-a0e2-a5da4317522c could not be found. Nov 02 14:52:08.850876 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-c08a22af-890a-43d7-8c6d-6349f0b893a7 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Request method failure captured: Nov 02 14:52:08.850876 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: request: DELETE /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c HTTP/1.1 Nov 02 14:52:08.850876 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Accept: application/json Nov 02 14:52:08.850876 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Accept-Encoding: identity Nov 02 14:52:08.850876 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Connection: close Nov 02 14:52:08.850876 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Content-Length: 0 Nov 02 14:52:08.850876 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Content-Type: application/json Nov 02 14:52:08.850876 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Host: 10.222.0.30 Nov 02 14:52:08.850876 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Openstack-System-Scope: None Nov 02 14:52:08.850876 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: User-Agent: python-urllib3/1.26.12 Nov 02 14:52:08.850876 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Auth-Token: gAAAAABjYoJU8mRtfklw2BqB8rxFPb9k4q0WLzod3pzKmTOxEu-Rawboc6-18-tFhoQU0IBY1PalXTbgXqEb5svZEk4EM19nsBvNwEJ9rKdAGE2eZMXT00nXhJe0Nq67h_qpM4Csttau-wzu2afBMob496zDR_AX_Vw_7hryB10KQXmXtCuC5P8 Nov 02 14:52:08.850876 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Domain-Id: None Nov 02 14:52:08.850876 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Domain-Name: None Nov 02 14:52:08.850876 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Identity-Status: Confirmed Nov 02 14:52:08.850876 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Is-Admin-Project: True Nov 02 14:52:08.850876 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Domain-Id: default Nov 02 14:52:08.850876 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Domain-Name: Default Nov 02 14:52:08.850876 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Id: 990b7e753ad1450489668d0ca151736e Nov 02 14:52:08.850876 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Name: tempest-TestVolumeBootPattern-1105129780 Nov 02 14:52:08.850876 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Role: reader,member Nov 02 14:52:08.850876 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Roles: reader,member Nov 02 14:52:08.853021 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/990b7e753ad1450489668d0ca151736e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/990b7e753ad1450489668d0ca151736e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/990b7e753ad1450489668d0ca151736e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_990b7e753ad1450489668d0ca151736e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:52:08.853021 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant: tempest-TestVolumeBootPattern-1105129780 Nov 02 14:52:08.853021 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant-Id: 990b7e753ad1450489668d0ca151736e Nov 02 14:52:08.853021 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant-Name: tempest-TestVolumeBootPattern-1105129780 Nov 02 14:52:08.853021 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User: tempest-TestVolumeBootPattern-1105129780-project Nov 02 14:52:08.853021 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Domain-Id: default Nov 02 14:52:08.853021 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Domain-Name: Default Nov 02 14:52:08.853021 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Id: 6f0516ac4c6648f9b208a89e174da3a3 Nov 02 14:52:08.853021 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Name: tempest-TestVolumeBootPattern-1105129780-project Nov 02 14:52:08.853021 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: method: > Nov 02 14:52:08.853021 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: exception: Instance a70e0509-33cf-40a8-a0e2-a5da4317522c could not be found. Nov 02 14:52:08.853021 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: action_args: {'id': 'a70e0509-33cf-40a8-a0e2-a5da4317522c'} Nov 02 14:52:08.853868 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:52:08.853868 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:52:08.853868 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:52:08.853868 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:52:08.853868 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:52:08.853868 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:52:08.853868 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:52:08.853868 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:52:08.853868 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:52:08.853868 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:52:08.853868 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a70e0509-33cf-40a8-a0e2-a5da4317522c could not be found. Nov 02 14:52:08.853868 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:52:08.853868 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:52:08.853868 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:52:08.853868 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:52:08.853868 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:52:08.853868 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:52:08.853868 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:52:08.853868 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:52:08.853868 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:52:08.855589 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:52:08.855589 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:52:08.855589 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:52:08.855589 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:52:08.855589 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:52:08.855589 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:52:08.855589 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:52:08.855589 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:52:08.855589 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:52:08.855589 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a70e0509-33cf-40a8-a0e2-a5da4317522c could not be found. Nov 02 14:52:08.855589 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:52:08.855589 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:52:08.855589 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:52:08.855589 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:52:08.855589 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:52:08.855589 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:52:08.855589 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:52:08.855589 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:52:08.855589 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a70e0509-33cf-40a8-a0e2-a5da4317522c could not be found. Nov 02 14:52:08.855589 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:52:08.857631 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-c08a22af-890a-43d7-8c6d-6349f0b893a7 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Returning 404 to user: Instance a70e0509-33cf-40a8-a0e2-a5da4317522c could not be found. {{(pid=119659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:52:08.857631 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-c08a22af-890a-43d7-8c6d-6349f0b893a7 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c" status: 404 len: 111 microversion: 2.1 time: 0.032851 Nov 02 14:52:08.857631 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 540/1051] 10.222.0.30 () {58 vars in 1239 bytes} [Wed Nov 2 14:52:08 2022] DELETE /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:52:08.862227 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-44216e03-60b6-4c35-8437-7b0b7849f184 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:52:08.862835 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-44216e03-60b6-4c35-8437-7b0b7849f184 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] [instance: a70e0509-33cf-40a8-a0e2-a5da4317522c] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:52:08.869187 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-44216e03-60b6-4c35-8437-7b0b7849f184 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:08.869948 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-44216e03-60b6-4c35-8437-7b0b7849f184 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:08.870364 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-44216e03-60b6-4c35-8437-7b0b7849f184 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:08.871071 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-44216e03-60b6-4c35-8437-7b0b7849f184 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:08.871521 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-44216e03-60b6-4c35-8437-7b0b7849f184 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:08.872023 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-44216e03-60b6-4c35-8437-7b0b7849f184 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:08.886384 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.wsgi [None req-44216e03-60b6-4c35-8437-7b0b7849f184 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] HTTP exception thrown: Instance a70e0509-33cf-40a8-a0e2-a5da4317522c could not be found. Nov 02 14:52:08.888157 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-44216e03-60b6-4c35-8437-7b0b7849f184 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Request method failure captured: Nov 02 14:52:08.888157 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: request: GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c HTTP/1.1 Nov 02 14:52:08.888157 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Accept: application/json Nov 02 14:52:08.888157 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Accept-Encoding: identity Nov 02 14:52:08.888157 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Connection: close Nov 02 14:52:08.888157 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Content-Length: 0 Nov 02 14:52:08.888157 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Content-Type: application/json Nov 02 14:52:08.888157 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Host: 10.222.0.30 Nov 02 14:52:08.888157 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Openstack-System-Scope: None Nov 02 14:52:08.888157 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: User-Agent: python-urllib3/1.26.12 Nov 02 14:52:08.888157 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Auth-Token: gAAAAABjYoJU8mRtfklw2BqB8rxFPb9k4q0WLzod3pzKmTOxEu-Rawboc6-18-tFhoQU0IBY1PalXTbgXqEb5svZEk4EM19nsBvNwEJ9rKdAGE2eZMXT00nXhJe0Nq67h_qpM4Csttau-wzu2afBMob496zDR_AX_Vw_7hryB10KQXmXtCuC5P8 Nov 02 14:52:08.888157 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Domain-Id: None Nov 02 14:52:08.888157 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Domain-Name: None Nov 02 14:52:08.888157 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Identity-Status: Confirmed Nov 02 14:52:08.888157 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Is-Admin-Project: True Nov 02 14:52:08.888157 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Domain-Id: default Nov 02 14:52:08.888157 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Domain-Name: Default Nov 02 14:52:08.888157 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Id: 990b7e753ad1450489668d0ca151736e Nov 02 14:52:08.888157 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Name: tempest-TestVolumeBootPattern-1105129780 Nov 02 14:52:08.888157 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Role: reader,member Nov 02 14:52:08.888157 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Roles: reader,member Nov 02 14:52:08.889725 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/990b7e753ad1450489668d0ca151736e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/990b7e753ad1450489668d0ca151736e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/990b7e753ad1450489668d0ca151736e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_990b7e753ad1450489668d0ca151736e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:52:08.889725 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant: tempest-TestVolumeBootPattern-1105129780 Nov 02 14:52:08.889725 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant-Id: 990b7e753ad1450489668d0ca151736e Nov 02 14:52:08.889725 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant-Name: tempest-TestVolumeBootPattern-1105129780 Nov 02 14:52:08.889725 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User: tempest-TestVolumeBootPattern-1105129780-project Nov 02 14:52:08.889725 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Domain-Id: default Nov 02 14:52:08.889725 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Domain-Name: Default Nov 02 14:52:08.889725 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Id: 6f0516ac4c6648f9b208a89e174da3a3 Nov 02 14:52:08.889725 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Name: tempest-TestVolumeBootPattern-1105129780-project Nov 02 14:52:08.889725 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: method: > Nov 02 14:52:08.889725 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: exception: Instance a70e0509-33cf-40a8-a0e2-a5da4317522c could not be found. Nov 02 14:52:08.889725 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: action_args: {'id': 'a70e0509-33cf-40a8-a0e2-a5da4317522c'} Nov 02 14:52:08.890616 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:52:08.890616 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:52:08.890616 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:52:08.890616 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:52:08.890616 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:52:08.890616 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:52:08.890616 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:52:08.890616 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:52:08.890616 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:52:08.890616 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:52:08.890616 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a70e0509-33cf-40a8-a0e2-a5da4317522c could not be found. Nov 02 14:52:08.890616 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:52:08.890616 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:52:08.890616 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:52:08.890616 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:52:08.890616 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:52:08.890616 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:52:08.890616 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:52:08.890616 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:52:08.890616 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:52:08.891946 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:52:08.891946 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:52:08.891946 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:52:08.891946 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:52:08.891946 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:52:08.891946 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:52:08.891946 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:52:08.891946 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a70e0509-33cf-40a8-a0e2-a5da4317522c could not be found. Nov 02 14:52:08.891946 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:52:08.891946 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:52:08.891946 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:52:08.891946 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:52:08.891946 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:52:08.891946 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:52:08.891946 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:52:08.891946 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:52:08.891946 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a70e0509-33cf-40a8-a0e2-a5da4317522c could not be found. Nov 02 14:52:08.891946 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:52:08.893145 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-44216e03-60b6-4c35-8437-7b0b7849f184 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Returning 404 to user: Instance a70e0509-33cf-40a8-a0e2-a5da4317522c could not be found. {{(pid=119658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:52:08.893145 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-44216e03-60b6-4c35-8437-7b0b7849f184 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c" status: 404 len: 111 microversion: 2.1 time: 0.031176 Nov 02 14:52:08.893145 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 512/1052] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:52:08 2022] GET /compute/v2.1/servers/a70e0509-33cf-40a8-a0e2-a5da4317522c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 14:52:10.623014 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-5e42788e-13f1-4412-a8f4-eda6a8104be4 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] Calling method '.version_select at 0x7fb24ee9d310>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:52:10.738591 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-5e42788e-13f1-4412-a8f4-eda6a8104be4 tempest-TestVolumeBootPattern-1105129780 tempest-TestVolumeBootPattern-1105129780-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-667872314" status: 202 len: 0 microversion: 2.1 time: 0.119637 Nov 02 14:52:10.739155 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 541/1053] 10.222.0.30 () {58 vars in 1260 bytes} [Wed Nov 2 14:52:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-667872314 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:52:14.154055 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-350e63c2-52ec-41d4-9250-e8c2a38731bb tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2118189951", "imageRef": "a726a246-cc7f-46e6-aeff-4d62e03cc091", "flavorRef": "452", "networks": [{"uuid": "fce77a31-1f15-466b-8f96-151c8cb7a2de"}]}} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:52:14.211349 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.network.neutron [None req-350e63c2-52ec-41d4-9250-e8c2a38731bb tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] validate_networks() for [('fce77a31-1f15-466b-8f96-151c8cb7a2de', None, None, None, None, None)] {{(pid=119658) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:52:15.084928 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-350e63c2-52ec-41d4-9250-e8c2a38731bb tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Flavor limits 0:0:0 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:52:15.085388 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-350e63c2-52ec-41d4-9250-e8c2a38731bb tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Image limits 0:0:0 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:52:15.085932 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-350e63c2-52ec-41d4-9250-e8c2a38731bb tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Flavor pref 0:0:0 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:52:15.086439 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-350e63c2-52ec-41d4-9250-e8c2a38731bb tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Image pref 0:0:0 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:52:15.087061 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-350e63c2-52ec-41d4-9250-e8c2a38731bb tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:52:15.096183 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-350e63c2-52ec-41d4-9250-e8c2a38731bb tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:15.096674 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-350e63c2-52ec-41d4-9250-e8c2a38731bb tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:15.097162 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-350e63c2-52ec-41d4-9250-e8c2a38731bb tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:15.097899 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-350e63c2-52ec-41d4-9250-e8c2a38731bb tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:15.098361 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-350e63c2-52ec-41d4-9250-e8c2a38731bb tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:15.098793 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-350e63c2-52ec-41d4-9250-e8c2a38731bb tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:15.117131 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.quota [None req-350e63c2-52ec-41d4-9250-e8c2a38731bb tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Getting quotas for project e6956385cb1846b8b02bc517a81ce1fa. Resources: {'instances', 'ram', 'cores'} {{(pid=119658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:52:15.122763 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.quota [None req-350e63c2-52ec-41d4-9250-e8c2a38731bb tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Getting quotas for user 4e30582f46214d05a85f2b0542e69ed7 and project e6956385cb1846b8b02bc517a81ce1fa. Resources: {'instances', 'ram', 'cores'} {{(pid=119658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:52:15.137742 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-350e63c2-52ec-41d4-9250-e8c2a38731bb tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Going to run 1 instances... {{(pid=119658) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:52:15.146165 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-350e63c2-52ec-41d4-9250-e8c2a38731bb tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] [instance: e48f4b17-b4bd-4548-b748-8281a50427c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a726a246-cc7f-46e6-aeff-4d62e03cc091',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119658) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:52:15.333731 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-350e63c2-52ec-41d4-9250-e8c2a38731bb tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.183495 Nov 02 14:52:15.340881 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 513/1054] 10.222.0.30 () {60 vars in 1147 bytes} [Wed Nov 2 14:52:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1192 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:52:15.347543 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-158e851e-0cda-449a-9c12-4fc5c0fdb554 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:52:15.352340 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-158e851e-0cda-449a-9c12-4fc5c0fdb554 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] [instance: e48f4b17-b4bd-4548-b748-8281a50427c2] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:52:15.410969 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-158e851e-0cda-449a-9c12-4fc5c0fdb554 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30582f46214d05a85f2b0542e69ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6956385cb1846b8b02bc517a81ce1fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:52:15.419516 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-158e851e-0cda-449a-9c12-4fc5c0fdb554 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] 10.222.0.30 "GET /compute/v2.1/servers/e48f4b17-b4bd-4548-b748-8281a50427c2" status: 200 len: 1219 microversion: 2.1 time: 0.076974 Nov 02 14:52:15.420418 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 542/1055] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:52:15 2022] GET /compute/v2.1/servers/e48f4b17-b4bd-4548-b748-8281a50427c2 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:52:16.443088 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-d6403b36-a637-40cf-8a9d-cf8b62d6ac34 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:52:16.443724 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-d6403b36-a637-40cf-8a9d-cf8b62d6ac34 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] [instance: e48f4b17-b4bd-4548-b748-8281a50427c2] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:52:16.506638 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-d6403b36-a637-40cf-8a9d-cf8b62d6ac34 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30582f46214d05a85f2b0542e69ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6956385cb1846b8b02bc517a81ce1fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:52:16.514778 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-d6403b36-a637-40cf-8a9d-cf8b62d6ac34 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] 10.222.0.30 "GET /compute/v2.1/servers/e48f4b17-b4bd-4548-b748-8281a50427c2" status: 200 len: 1219 microversion: 2.1 time: 0.075465 Nov 02 14:52:16.515445 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 514/1056] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:52:16 2022] GET /compute/v2.1/servers/e48f4b17-b4bd-4548-b748-8281a50427c2 => generated 1219 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:52:17.540584 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-4635b722-b6b7-431c-8225-eebe5c20115d tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:52:17.541221 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-4635b722-b6b7-431c-8225-eebe5c20115d tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] [instance: e48f4b17-b4bd-4548-b748-8281a50427c2] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:52:17.547556 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4635b722-b6b7-431c-8225-eebe5c20115d tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:17.548042 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4635b722-b6b7-431c-8225-eebe5c20115d tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:17.548479 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4635b722-b6b7-431c-8225-eebe5c20115d tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:17.549205 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4635b722-b6b7-431c-8225-eebe5c20115d tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:17.549658 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4635b722-b6b7-431c-8225-eebe5c20115d tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:17.550150 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4635b722-b6b7-431c-8225-eebe5c20115d tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:17.619740 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-4635b722-b6b7-431c-8225-eebe5c20115d tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30582f46214d05a85f2b0542e69ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6956385cb1846b8b02bc517a81ce1fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:52:17.628155 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-4635b722-b6b7-431c-8225-eebe5c20115d tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] 10.222.0.30 "GET /compute/v2.1/servers/e48f4b17-b4bd-4548-b748-8281a50427c2" status: 200 len: 1271 microversion: 2.1 time: 0.092025 Nov 02 14:52:17.628742 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 543/1057] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:52:17 2022] GET /compute/v2.1/servers/e48f4b17-b4bd-4548-b748-8281a50427c2 => generated 1271 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:52:18.652197 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-7c52da30-e44b-4b34-9c70-3f165e7c4931 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:52:18.653088 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-7c52da30-e44b-4b34-9c70-3f165e7c4931 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] [instance: e48f4b17-b4bd-4548-b748-8281a50427c2] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:52:18.661096 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7c52da30-e44b-4b34-9c70-3f165e7c4931 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:18.661638 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7c52da30-e44b-4b34-9c70-3f165e7c4931 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:18.662090 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7c52da30-e44b-4b34-9c70-3f165e7c4931 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:18.662962 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7c52da30-e44b-4b34-9c70-3f165e7c4931 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:18.663614 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7c52da30-e44b-4b34-9c70-3f165e7c4931 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:18.664049 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7c52da30-e44b-4b34-9c70-3f165e7c4931 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:18.736207 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-7c52da30-e44b-4b34-9c70-3f165e7c4931 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30582f46214d05a85f2b0542e69ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6956385cb1846b8b02bc517a81ce1fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:52:18.745063 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-7c52da30-e44b-4b34-9c70-3f165e7c4931 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] 10.222.0.30 "GET /compute/v2.1/servers/e48f4b17-b4bd-4548-b748-8281a50427c2" status: 200 len: 1277 microversion: 2.1 time: 0.096904 Nov 02 14:52:18.745900 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 515/1058] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:52:18 2022] GET /compute/v2.1/servers/e48f4b17-b4bd-4548-b748-8281a50427c2 => generated 1277 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:52:19.768860 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-dd56658d-5959-4e4f-bc7e-28ee00d7e34b tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:52:19.769463 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-dd56658d-5959-4e4f-bc7e-28ee00d7e34b tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] [instance: e48f4b17-b4bd-4548-b748-8281a50427c2] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:52:19.780733 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-dd56658d-5959-4e4f-bc7e-28ee00d7e34b tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:19.781266 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-dd56658d-5959-4e4f-bc7e-28ee00d7e34b tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:19.781703 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-dd56658d-5959-4e4f-bc7e-28ee00d7e34b tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:19.782428 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-dd56658d-5959-4e4f-bc7e-28ee00d7e34b tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:19.782912 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-dd56658d-5959-4e4f-bc7e-28ee00d7e34b tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:19.783336 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-dd56658d-5959-4e4f-bc7e-28ee00d7e34b tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:19.927535 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-dd56658d-5959-4e4f-bc7e-28ee00d7e34b tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30582f46214d05a85f2b0542e69ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6956385cb1846b8b02bc517a81ce1fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:52:19.936094 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-dd56658d-5959-4e4f-bc7e-28ee00d7e34b tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] 10.222.0.30 "GET /compute/v2.1/servers/e48f4b17-b4bd-4548-b748-8281a50427c2" status: 200 len: 1319 microversion: 2.1 time: 0.171259 Nov 02 14:52:19.936669 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 544/1059] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:52:19 2022] GET /compute/v2.1/servers/e48f4b17-b4bd-4548-b748-8281a50427c2 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:52:20.395731 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [req-10f3e37d-6bab-4119-a855-566c24a84243 req-f4a49674-7ddd-4077-b45b-7d4987c7cc94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e48f4b17-b4bd-4548-b748-8281a50427c2", "tag": "c98951a1-6e3a-4462-96ee-1ea5575212da"}]} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:52:20.406868 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-10f3e37d-6bab-4119-a855-566c24a84243 req-f4a49674-7ddd-4077-b45b-7d4987c7cc94 service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:20.407353 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-10f3e37d-6bab-4119-a855-566c24a84243 req-f4a49674-7ddd-4077-b45b-7d4987c7cc94 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:20.407896 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-10f3e37d-6bab-4119-a855-566c24a84243 req-f4a49674-7ddd-4077-b45b-7d4987c7cc94 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:20.420101 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.compute.server_external_events [req-10f3e37d-6bab-4119-a855-566c24a84243 req-f4a49674-7ddd-4077-b45b-7d4987c7cc94 service nova] Creating event network-changed:c98951a1-6e3a-4462-96ee-1ea5575212da for instance e48f4b17-b4bd-4548-b748-8281a50427c2 on hv-cinder-86236 Nov 02 14:52:20.426244 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [req-10f3e37d-6bab-4119-a855-566c24a84243 req-f4a49674-7ddd-4077-b45b-7d4987c7cc94 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034095 Nov 02 14:52:20.427120 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 516/1060] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:52:20.959075 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-292e9e72-82e1-4af2-b18e-ba30e0167515 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:52:20.960399 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-292e9e72-82e1-4af2-b18e-ba30e0167515 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] [instance: e48f4b17-b4bd-4548-b748-8281a50427c2] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:52:20.967224 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-292e9e72-82e1-4af2-b18e-ba30e0167515 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:20.967971 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-292e9e72-82e1-4af2-b18e-ba30e0167515 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:20.968419 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-292e9e72-82e1-4af2-b18e-ba30e0167515 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:20.969146 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-292e9e72-82e1-4af2-b18e-ba30e0167515 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:20.969602 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-292e9e72-82e1-4af2-b18e-ba30e0167515 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:20.970033 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-292e9e72-82e1-4af2-b18e-ba30e0167515 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:21.134960 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-292e9e72-82e1-4af2-b18e-ba30e0167515 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30582f46214d05a85f2b0542e69ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6956385cb1846b8b02bc517a81ce1fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:52:21.151330 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-292e9e72-82e1-4af2-b18e-ba30e0167515 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] 10.222.0.30 "GET /compute/v2.1/servers/e48f4b17-b4bd-4548-b748-8281a50427c2" status: 200 len: 1319 microversion: 2.1 time: 0.195629 Nov 02 14:52:21.165608 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 545/1061] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:52:20 2022] GET /compute/v2.1/servers/e48f4b17-b4bd-4548-b748-8281a50427c2 => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:52:22.186787 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-cd77b816-8fa7-4f4d-ab6a-ae2e11385c91 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:52:22.187356 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-cd77b816-8fa7-4f4d-ab6a-ae2e11385c91 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] [instance: e48f4b17-b4bd-4548-b748-8281a50427c2] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:52:22.194151 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-cd77b816-8fa7-4f4d-ab6a-ae2e11385c91 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:22.194634 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-cd77b816-8fa7-4f4d-ab6a-ae2e11385c91 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:22.195066 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-cd77b816-8fa7-4f4d-ab6a-ae2e11385c91 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:22.195761 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-cd77b816-8fa7-4f4d-ab6a-ae2e11385c91 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:22.196371 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-cd77b816-8fa7-4f4d-ab6a-ae2e11385c91 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:22.196796 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-cd77b816-8fa7-4f4d-ab6a-ae2e11385c91 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:22.331554 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-cd77b816-8fa7-4f4d-ab6a-ae2e11385c91 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30582f46214d05a85f2b0542e69ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6956385cb1846b8b02bc517a81ce1fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:52:22.340414 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-cd77b816-8fa7-4f4d-ab6a-ae2e11385c91 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] 10.222.0.30 "GET /compute/v2.1/servers/e48f4b17-b4bd-4548-b748-8281a50427c2" status: 200 len: 1319 microversion: 2.1 time: 0.158097 Nov 02 14:52:22.340990 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 517/1062] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:52:22 2022] GET /compute/v2.1/servers/e48f4b17-b4bd-4548-b748-8281a50427c2 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:52:23.363901 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-a074aefc-3e46-4874-b52e-f50dcd4fe35e tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:52:23.364506 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-a074aefc-3e46-4874-b52e-f50dcd4fe35e tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] [instance: e48f4b17-b4bd-4548-b748-8281a50427c2] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:52:23.371893 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a074aefc-3e46-4874-b52e-f50dcd4fe35e tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:23.372371 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a074aefc-3e46-4874-b52e-f50dcd4fe35e tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:23.372807 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a074aefc-3e46-4874-b52e-f50dcd4fe35e tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:23.373517 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a074aefc-3e46-4874-b52e-f50dcd4fe35e tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:23.373966 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a074aefc-3e46-4874-b52e-f50dcd4fe35e tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:23.374391 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a074aefc-3e46-4874-b52e-f50dcd4fe35e tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:23.511829 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-a074aefc-3e46-4874-b52e-f50dcd4fe35e tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30582f46214d05a85f2b0542e69ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6956385cb1846b8b02bc517a81ce1fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:52:23.519903 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-a074aefc-3e46-4874-b52e-f50dcd4fe35e tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] 10.222.0.30 "GET /compute/v2.1/servers/e48f4b17-b4bd-4548-b748-8281a50427c2" status: 200 len: 1319 microversion: 2.1 time: 0.159827 Nov 02 14:52:23.520489 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 546/1063] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:52:23 2022] GET /compute/v2.1/servers/e48f4b17-b4bd-4548-b748-8281a50427c2 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:52:24.543017 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-ca10e2e1-967c-4ee6-b498-340f7e9d8d80 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:52:24.543566 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-ca10e2e1-967c-4ee6-b498-340f7e9d8d80 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] [instance: e48f4b17-b4bd-4548-b748-8281a50427c2] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:52:24.550193 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ca10e2e1-967c-4ee6-b498-340f7e9d8d80 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:24.550678 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ca10e2e1-967c-4ee6-b498-340f7e9d8d80 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:24.551118 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ca10e2e1-967c-4ee6-b498-340f7e9d8d80 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:24.551809 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ca10e2e1-967c-4ee6-b498-340f7e9d8d80 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:24.552258 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ca10e2e1-967c-4ee6-b498-340f7e9d8d80 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:24.552703 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ca10e2e1-967c-4ee6-b498-340f7e9d8d80 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:24.686134 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-ca10e2e1-967c-4ee6-b498-340f7e9d8d80 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30582f46214d05a85f2b0542e69ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6956385cb1846b8b02bc517a81ce1fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:52:24.694112 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-ca10e2e1-967c-4ee6-b498-340f7e9d8d80 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] 10.222.0.30 "GET /compute/v2.1/servers/e48f4b17-b4bd-4548-b748-8281a50427c2" status: 200 len: 1319 microversion: 2.1 time: 0.155631 Nov 02 14:52:24.694688 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 518/1064] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:52:24 2022] GET /compute/v2.1/servers/e48f4b17-b4bd-4548-b748-8281a50427c2 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:52:25.712474 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [req-b107dab4-3b09-4438-a69c-e27e949079a6 req-8bbae636-b6ad-41c3-b8dc-89e0b50ebe66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e48f4b17-b4bd-4548-b748-8281a50427c2", "name": "network-vif-plugged", "status": "completed", "tag": "c98951a1-6e3a-4462-96ee-1ea5575212da"}]} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:52:25.714034 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell0:SELECT=2 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:52:25.718634 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-779be801-0436-4eb1-9403-99bd5951e814 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:52:25.719266 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-779be801-0436-4eb1-9403-99bd5951e814 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] [instance: e48f4b17-b4bd-4548-b748-8281a50427c2] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:52:25.719589 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-b107dab4-3b09-4438-a69c-e27e949079a6 req-8bbae636-b6ad-41c3-b8dc-89e0b50ebe66 service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:25.720081 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-b107dab4-3b09-4438-a69c-e27e949079a6 req-8bbae636-b6ad-41c3-b8dc-89e0b50ebe66 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:25.720517 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-b107dab4-3b09-4438-a69c-e27e949079a6 req-8bbae636-b6ad-41c3-b8dc-89e0b50ebe66 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:25.721316 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell0:SELECT=2 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:52:25.727268 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-779be801-0436-4eb1-9403-99bd5951e814 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:25.727767 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-779be801-0436-4eb1-9403-99bd5951e814 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:25.728211 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-779be801-0436-4eb1-9403-99bd5951e814 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:25.728944 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-779be801-0436-4eb1-9403-99bd5951e814 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:25.729438 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-779be801-0436-4eb1-9403-99bd5951e814 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:25.729871 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-779be801-0436-4eb1-9403-99bd5951e814 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:25.732941 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.compute.server_external_events [req-b107dab4-3b09-4438-a69c-e27e949079a6 req-8bbae636-b6ad-41c3-b8dc-89e0b50ebe66 service nova] Creating event network-vif-plugged:c98951a1-6e3a-4462-96ee-1ea5575212da for instance e48f4b17-b4bd-4548-b748-8281a50427c2 on hv-cinder-86236 Nov 02 14:52:25.738292 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [req-b107dab4-3b09-4438-a69c-e27e949079a6 req-8bbae636-b6ad-41c3-b8dc-89e0b50ebe66 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034806 Nov 02 14:52:25.738928 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 547/1065] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:52:25.882190 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-779be801-0436-4eb1-9403-99bd5951e814 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30582f46214d05a85f2b0542e69ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6956385cb1846b8b02bc517a81ce1fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:52:25.894631 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-779be801-0436-4eb1-9403-99bd5951e814 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] 10.222.0.30 "GET /compute/v2.1/servers/e48f4b17-b4bd-4548-b748-8281a50427c2" status: 200 len: 1319 microversion: 2.1 time: 0.177725 Nov 02 14:52:25.894631 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 519/1066] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:52:25 2022] GET /compute/v2.1/servers/e48f4b17-b4bd-4548-b748-8281a50427c2 => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:52:26.916928 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-8358bf1c-012a-422d-86c7-698201eb1127 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:52:26.917657 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-8358bf1c-012a-422d-86c7-698201eb1127 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] [instance: e48f4b17-b4bd-4548-b748-8281a50427c2] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:52:26.919598 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:52:26.924617 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8358bf1c-012a-422d-86c7-698201eb1127 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:26.925151 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8358bf1c-012a-422d-86c7-698201eb1127 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:26.929984 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8358bf1c-012a-422d-86c7-698201eb1127 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:26.929984 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8358bf1c-012a-422d-86c7-698201eb1127 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:26.929984 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8358bf1c-012a-422d-86c7-698201eb1127 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:26.929984 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-8358bf1c-012a-422d-86c7-698201eb1127 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:26.931035 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:52:27.062611 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-8358bf1c-012a-422d-86c7-698201eb1127 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30582f46214d05a85f2b0542e69ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6956385cb1846b8b02bc517a81ce1fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:52:27.070296 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-8358bf1c-012a-422d-86c7-698201eb1127 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] 10.222.0.30 "GET /compute/v2.1/servers/e48f4b17-b4bd-4548-b748-8281a50427c2" status: 200 len: 1319 microversion: 2.1 time: 0.158979 Nov 02 14:52:27.070866 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 548/1067] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:52:26 2022] GET /compute/v2.1/servers/e48f4b17-b4bd-4548-b748-8281a50427c2 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:52:28.094300 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-a0b1de0b-9fce-48ad-8791-d732df59d37b tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:52:28.094938 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-a0b1de0b-9fce-48ad-8791-d732df59d37b tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] [instance: e48f4b17-b4bd-4548-b748-8281a50427c2] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:52:28.096730 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell0:SELECT=8 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:52:28.097883 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:52:28.102785 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a0b1de0b-9fce-48ad-8791-d732df59d37b tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:28.103314 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a0b1de0b-9fce-48ad-8791-d732df59d37b tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:28.103770 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a0b1de0b-9fce-48ad-8791-d732df59d37b tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:28.104513 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a0b1de0b-9fce-48ad-8791-d732df59d37b tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:28.104965 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a0b1de0b-9fce-48ad-8791-d732df59d37b tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:28.105567 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-a0b1de0b-9fce-48ad-8791-d732df59d37b tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:28.250991 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-a0b1de0b-9fce-48ad-8791-d732df59d37b tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30582f46214d05a85f2b0542e69ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6956385cb1846b8b02bc517a81ce1fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:52:28.253246 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:52:28.260118 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-a0b1de0b-9fce-48ad-8791-d732df59d37b tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] 10.222.0.30 "GET /compute/v2.1/servers/e48f4b17-b4bd-4548-b748-8281a50427c2" status: 200 len: 1509 microversion: 2.1 time: 0.170010 Nov 02 14:52:28.260874 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 520/1068] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:52:28 2022] GET /compute/v2.1/servers/e48f4b17-b4bd-4548-b748-8281a50427c2 => generated 1509 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:52:43.822270 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-5b50f8c3-9d80-4e83-8724-18876ca0f381 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e968bf7f-e449-48f4-8fef-1231333a1cfc", "device": "/dev/sdb"}} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:52:43.825109 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-5b50f8c3-9d80-4e83-8724-18876ca0f381 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] [instance: e48f4b17-b4bd-4548-b748-8281a50427c2] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:52:43.833324 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5b50f8c3-9d80-4e83-8724-18876ca0f381 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:43.833806 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5b50f8c3-9d80-4e83-8724-18876ca0f381 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:43.834237 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5b50f8c3-9d80-4e83-8724-18876ca0f381 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:43.834931 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5b50f8c3-9d80-4e83-8724-18876ca0f381 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:43.835395 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5b50f8c3-9d80-4e83-8724-18876ca0f381 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:43.835794 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5b50f8c3-9d80-4e83-8724-18876ca0f381 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:44.706977 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-5b50f8c3-9d80-4e83-8724-18876ca0f381 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] 10.222.0.30 "POST /compute/v2.1/servers/e48f4b17-b4bd-4548-b748-8281a50427c2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.888607 Nov 02 14:52:44.707593 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 549/1069] 10.222.0.30 () {60 vars in 1323 bytes} [Wed Nov 2 14:52:43 2022] POST /compute/v2.1/servers/e48f4b17-b4bd-4548-b748-8281a50427c2/os-volume_attachments => generated 194 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:53:09.663180 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-fee13ad0-2c04-4d61-bb90-72334130329b tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:53:09.663791 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-fee13ad0-2c04-4d61-bb90-72334130329b tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] [instance: e48f4b17-b4bd-4548-b748-8281a50427c2] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:53:09.670894 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-fee13ad0-2c04-4d61-bb90-72334130329b tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:09.671385 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-fee13ad0-2c04-4d61-bb90-72334130329b tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:09.671828 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-fee13ad0-2c04-4d61-bb90-72334130329b tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:09.672530 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-fee13ad0-2c04-4d61-bb90-72334130329b tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:09.672984 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-fee13ad0-2c04-4d61-bb90-72334130329b tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:09.673510 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-fee13ad0-2c04-4d61-bb90-72334130329b tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:09.759303 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.objects.instance [None req-fee13ad0-2c04-4d61-bb90-72334130329b tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lazy-loading 'services' on Instance uuid e48f4b17-b4bd-4548-b748-8281a50427c2 {{(pid=119658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:53:10.023050 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-fee13ad0-2c04-4d61-bb90-72334130329b tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e48f4b17-b4bd-4548-b748-8281a50427c2/os-volume_attachments/e968bf7f-e449-48f4-8fef-1231333a1cfc" status: 202 len: 0 microversion: 2.1 time: 0.364530 Nov 02 14:53:10.023734 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 521/1070] 10.222.0.30 () {58 vars in 1416 bytes} [Wed Nov 2 14:53:09 2022] DELETE /compute/v2.1/servers/e48f4b17-b4bd-4548-b748-8281a50427c2/os-volume_attachments/e968bf7f-e449-48f4-8fef-1231333a1cfc => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:53:11.156126 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-86f17688-633c-452b-b279-686875be5e67 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:53:11.156853 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-86f17688-633c-452b-b279-686875be5e67 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] [instance: e48f4b17-b4bd-4548-b748-8281a50427c2] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:53:11.159350 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_api:SELECT=3 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:53:11.160035 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:53:11.165628 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-86f17688-633c-452b-b279-686875be5e67 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:11.166101 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-86f17688-633c-452b-b279-686875be5e67 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:11.166529 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-86f17688-633c-452b-b279-686875be5e67 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:11.167223 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-86f17688-633c-452b-b279-686875be5e67 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:11.167701 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-86f17688-633c-452b-b279-686875be5e67 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:11.168118 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-86f17688-633c-452b-b279-686875be5e67 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:11.193281 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-86f17688-633c-452b-b279-686875be5e67 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] [instance: e48f4b17-b4bd-4548-b748-8281a50427c2] Going to try to terminate instance {{(pid=119659) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:53:11.611980 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-86f17688-633c-452b-b279-686875be5e67 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e48f4b17-b4bd-4548-b748-8281a50427c2" status: 204 len: 0 microversion: 2.1 time: 0.459727 Nov 02 14:53:11.612605 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 550/1071] 10.222.0.30 () {58 vars in 1239 bytes} [Wed Nov 2 14:53:11 2022] DELETE /compute/v2.1/servers/e48f4b17-b4bd-4548-b748-8281a50427c2 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:53:11.623324 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-7b350694-e543-44c5-a810-053ec85dff1e tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:53:11.624085 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-7b350694-e543-44c5-a810-053ec85dff1e tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] [instance: e48f4b17-b4bd-4548-b748-8281a50427c2] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:53:11.630494 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7b350694-e543-44c5-a810-053ec85dff1e tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:11.633745 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7b350694-e543-44c5-a810-053ec85dff1e tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:11.633745 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7b350694-e543-44c5-a810-053ec85dff1e tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:11.633745 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7b350694-e543-44c5-a810-053ec85dff1e tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:11.633745 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7b350694-e543-44c5-a810-053ec85dff1e tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:11.634126 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7b350694-e543-44c5-a810-053ec85dff1e tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:11.765372 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-7b350694-e543-44c5-a810-053ec85dff1e tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30582f46214d05a85f2b0542e69ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6956385cb1846b8b02bc517a81ce1fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:53:11.773137 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-7b350694-e543-44c5-a810-053ec85dff1e tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] 10.222.0.30 "GET /compute/v2.1/servers/e48f4b17-b4bd-4548-b748-8281a50427c2" status: 200 len: 1515 microversion: 2.1 time: 0.155045 Nov 02 14:53:11.773703 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 522/1072] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:53:11 2022] GET /compute/v2.1/servers/e48f4b17-b4bd-4548-b748-8281a50427c2 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:53:12.798042 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-015ef2da-4abd-4ddc-b03f-ac219e1c3dc1 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:53:12.798800 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-015ef2da-4abd-4ddc-b03f-ac219e1c3dc1 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] [instance: e48f4b17-b4bd-4548-b748-8281a50427c2] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:53:12.805948 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-015ef2da-4abd-4ddc-b03f-ac219e1c3dc1 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:12.806420 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-015ef2da-4abd-4ddc-b03f-ac219e1c3dc1 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:12.806852 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-015ef2da-4abd-4ddc-b03f-ac219e1c3dc1 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:12.807536 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-015ef2da-4abd-4ddc-b03f-ac219e1c3dc1 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:12.808009 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-015ef2da-4abd-4ddc-b03f-ac219e1c3dc1 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:12.808436 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-015ef2da-4abd-4ddc-b03f-ac219e1c3dc1 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:12.944891 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-015ef2da-4abd-4ddc-b03f-ac219e1c3dc1 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30582f46214d05a85f2b0542e69ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6956385cb1846b8b02bc517a81ce1fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:53:12.953018 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-015ef2da-4abd-4ddc-b03f-ac219e1c3dc1 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] 10.222.0.30 "GET /compute/v2.1/servers/e48f4b17-b4bd-4548-b748-8281a50427c2" status: 200 len: 1515 microversion: 2.1 time: 0.159668 Nov 02 14:53:12.953601 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 551/1073] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:53:12 2022] GET /compute/v2.1/servers/e48f4b17-b4bd-4548-b748-8281a50427c2 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:53:13.859099 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [req-185e10e7-20bc-442a-abf3-db970e8b0e48 req-9113b2fa-2d28-4411-a4eb-d18c6b0b691a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e48f4b17-b4bd-4548-b748-8281a50427c2", "name": "network-vif-deleted", "tag": "c98951a1-6e3a-4462-96ee-1ea5575212da"}]} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:53:13.870583 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-185e10e7-20bc-442a-abf3-db970e8b0e48 req-9113b2fa-2d28-4411-a4eb-d18c6b0b691a service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:13.871053 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-185e10e7-20bc-442a-abf3-db970e8b0e48 req-9113b2fa-2d28-4411-a4eb-d18c6b0b691a service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:13.871482 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-185e10e7-20bc-442a-abf3-db970e8b0e48 req-9113b2fa-2d28-4411-a4eb-d18c6b0b691a service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:13.883678 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.compute.server_external_events [req-185e10e7-20bc-442a-abf3-db970e8b0e48 req-9113b2fa-2d28-4411-a4eb-d18c6b0b691a service nova] Creating event network-vif-deleted:c98951a1-6e3a-4462-96ee-1ea5575212da for instance e48f4b17-b4bd-4548-b748-8281a50427c2 on hv-cinder-86236 Nov 02 14:53:13.888692 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [req-185e10e7-20bc-442a-abf3-db970e8b0e48 req-9113b2fa-2d28-4411-a4eb-d18c6b0b691a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033211 Nov 02 14:53:13.889657 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 523/1074] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:53:13.976524 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-f52ecadc-1d11-45bb-895d-7695ffafb330 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:53:13.977211 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-f52ecadc-1d11-45bb-895d-7695ffafb330 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] [instance: e48f4b17-b4bd-4548-b748-8281a50427c2] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:53:13.984073 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f52ecadc-1d11-45bb-895d-7695ffafb330 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:13.984531 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f52ecadc-1d11-45bb-895d-7695ffafb330 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:13.985100 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f52ecadc-1d11-45bb-895d-7695ffafb330 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:13.985717 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f52ecadc-1d11-45bb-895d-7695ffafb330 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:13.986170 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f52ecadc-1d11-45bb-895d-7695ffafb330 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:13.986593 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f52ecadc-1d11-45bb-895d-7695ffafb330 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:14.055931 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-f52ecadc-1d11-45bb-895d-7695ffafb330 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30582f46214d05a85f2b0542e69ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6956385cb1846b8b02bc517a81ce1fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:53:14.063791 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-f52ecadc-1d11-45bb-895d-7695ffafb330 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] 10.222.0.30 "GET /compute/v2.1/servers/e48f4b17-b4bd-4548-b748-8281a50427c2" status: 200 len: 1473 microversion: 2.1 time: 0.091372 Nov 02 14:53:14.064367 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 552/1075] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:53:13 2022] GET /compute/v2.1/servers/e48f4b17-b4bd-4548-b748-8281a50427c2 => generated 1473 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:53:15.088146 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-52fcb232-c57a-4710-ba11-79cd18cb0408 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:53:15.088840 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-52fcb232-c57a-4710-ba11-79cd18cb0408 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] [instance: e48f4b17-b4bd-4548-b748-8281a50427c2] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:53:15.094978 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-52fcb232-c57a-4710-ba11-79cd18cb0408 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:15.095459 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-52fcb232-c57a-4710-ba11-79cd18cb0408 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:15.095897 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-52fcb232-c57a-4710-ba11-79cd18cb0408 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:15.096580 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-52fcb232-c57a-4710-ba11-79cd18cb0408 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:15.097055 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-52fcb232-c57a-4710-ba11-79cd18cb0408 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:15.097489 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-52fcb232-c57a-4710-ba11-79cd18cb0408 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:15.128307 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-52fcb232-c57a-4710-ba11-79cd18cb0408 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:15.128785 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-52fcb232-c57a-4710-ba11-79cd18cb0408 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:15.129256 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-52fcb232-c57a-4710-ba11-79cd18cb0408 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:15.129698 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.objects.instance [None req-52fcb232-c57a-4710-ba11-79cd18cb0408 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lazy-loading 'fault' on Instance uuid e48f4b17-b4bd-4548-b748-8281a50427c2 {{(pid=119658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:53:15.175161 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-52fcb232-c57a-4710-ba11-79cd18cb0408 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30582f46214d05a85f2b0542e69ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6956385cb1846b8b02bc517a81ce1fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:53:15.184710 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-52fcb232-c57a-4710-ba11-79cd18cb0408 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] 10.222.0.30 "GET /compute/v2.1/servers/e48f4b17-b4bd-4548-b748-8281a50427c2" status: 200 len: 1309 microversion: 2.1 time: 0.101720 Nov 02 14:53:15.185382 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 524/1076] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:53:15 2022] GET /compute/v2.1/servers/e48f4b17-b4bd-4548-b748-8281a50427c2 => generated 1309 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:53:16.210188 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-20ef0a5b-6c0b-47c8-95c5-114f6c462d53 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:53:16.210808 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-20ef0a5b-6c0b-47c8-95c5-114f6c462d53 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] [instance: e48f4b17-b4bd-4548-b748-8281a50427c2] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:53:16.216889 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-20ef0a5b-6c0b-47c8-95c5-114f6c462d53 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:16.217402 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-20ef0a5b-6c0b-47c8-95c5-114f6c462d53 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:16.221095 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-20ef0a5b-6c0b-47c8-95c5-114f6c462d53 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:16.221095 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-20ef0a5b-6c0b-47c8-95c5-114f6c462d53 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:16.221095 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-20ef0a5b-6c0b-47c8-95c5-114f6c462d53 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:16.221095 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-20ef0a5b-6c0b-47c8-95c5-114f6c462d53 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:16.233345 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.wsgi [None req-20ef0a5b-6c0b-47c8-95c5-114f6c462d53 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] HTTP exception thrown: Instance e48f4b17-b4bd-4548-b748-8281a50427c2 could not be found. Nov 02 14:53:16.234983 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-20ef0a5b-6c0b-47c8-95c5-114f6c462d53 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Request method failure captured: Nov 02 14:53:16.234983 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: request: GET /compute/v2.1/servers/e48f4b17-b4bd-4548-b748-8281a50427c2 HTTP/1.1 Nov 02 14:53:16.234983 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Accept: application/json Nov 02 14:53:16.234983 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Accept-Encoding: identity Nov 02 14:53:16.234983 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Connection: close Nov 02 14:53:16.234983 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Content-Length: 0 Nov 02 14:53:16.234983 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Content-Type: application/json Nov 02 14:53:16.234983 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Host: 10.222.0.30 Nov 02 14:53:16.234983 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Openstack-System-Scope: None Nov 02 14:53:16.234983 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: User-Agent: python-urllib3/1.26.12 Nov 02 14:53:16.234983 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Auth-Token: gAAAAABjYoQbjhuCm9MRO8zcC3UBcUGkA2dL3RqhD2uaW6wM70qcUoo5NcGLJpEieVx4w6uIWUaZ7nYeTFix8idNvwnYeyp5EV8uNIPeST6nwvH4u9aCv3p0N5bnqXrtOlO0VKbM8Uuwu-JLQmyq1F078p_rANl44m5CLQ_Y13yhXaNZg9abvno Nov 02 14:53:16.234983 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Domain-Id: None Nov 02 14:53:16.234983 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Domain-Name: None Nov 02 14:53:16.234983 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Identity-Status: Confirmed Nov 02 14:53:16.234983 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Is-Admin-Project: True Nov 02 14:53:16.234983 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Domain-Id: default Nov 02 14:53:16.234983 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Domain-Name: Default Nov 02 14:53:16.234983 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Id: e6956385cb1846b8b02bc517a81ce1fa Nov 02 14:53:16.234983 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1938961982 Nov 02 14:53:16.234983 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Role: reader,member Nov 02 14:53:16.234983 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Roles: reader,member Nov 02 14:53:16.236898 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e6956385cb1846b8b02bc517a81ce1fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e6956385cb1846b8b02bc517a81ce1fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e6956385cb1846b8b02bc517a81ce1fa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e6956385cb1846b8b02bc517a81ce1fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:53:16.236898 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant: tempest-VolumesSnapshotTestJSON-1938961982 Nov 02 14:53:16.236898 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant-Id: e6956385cb1846b8b02bc517a81ce1fa Nov 02 14:53:16.236898 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1938961982 Nov 02 14:53:16.236898 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User: tempest-VolumesSnapshotTestJSON-1938961982-project Nov 02 14:53:16.236898 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Domain-Id: default Nov 02 14:53:16.236898 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Domain-Name: Default Nov 02 14:53:16.236898 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Id: 4e30582f46214d05a85f2b0542e69ed7 Nov 02 14:53:16.236898 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Name: tempest-VolumesSnapshotTestJSON-1938961982-project Nov 02 14:53:16.236898 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: method: > Nov 02 14:53:16.236898 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: exception: Instance e48f4b17-b4bd-4548-b748-8281a50427c2 could not be found. Nov 02 14:53:16.236898 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: action_args: {'id': 'e48f4b17-b4bd-4548-b748-8281a50427c2'} Nov 02 14:53:16.237828 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:53:16.237828 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:53:16.237828 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:53:16.237828 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:53:16.237828 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:53:16.237828 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:53:16.237828 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:53:16.237828 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:53:16.237828 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:53:16.237828 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:53:16.237828 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e48f4b17-b4bd-4548-b748-8281a50427c2 could not be found. Nov 02 14:53:16.237828 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:53:16.237828 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:53:16.237828 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:53:16.237828 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:53:16.237828 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:53:16.237828 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:53:16.237828 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:53:16.237828 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:53:16.237828 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:53:16.239209 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:53:16.239209 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:53:16.239209 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:53:16.239209 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:53:16.239209 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:53:16.239209 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:53:16.239209 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:53:16.239209 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e48f4b17-b4bd-4548-b748-8281a50427c2 could not be found. Nov 02 14:53:16.239209 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:53:16.239209 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:53:16.239209 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:53:16.239209 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:53:16.239209 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:53:16.239209 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:53:16.239209 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:53:16.239209 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:53:16.239209 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e48f4b17-b4bd-4548-b748-8281a50427c2 could not be found. Nov 02 14:53:16.239209 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:53:16.240535 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-20ef0a5b-6c0b-47c8-95c5-114f6c462d53 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Returning 404 to user: Instance e48f4b17-b4bd-4548-b748-8281a50427c2 could not be found. {{(pid=119659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:53:16.240535 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-20ef0a5b-6c0b-47c8-95c5-114f6c462d53 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] 10.222.0.30 "GET /compute/v2.1/servers/e48f4b17-b4bd-4548-b748-8281a50427c2" status: 404 len: 111 microversion: 2.1 time: 0.030951 Nov 02 14:53:16.240535 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 553/1077] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:53:16 2022] GET /compute/v2.1/servers/e48f4b17-b4bd-4548-b748-8281a50427c2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:53:25.905816 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-1182c0fb-0264-4d0a-805e-d0a89414d291 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2143422313", "imageRef": "a726a246-cc7f-46e6-aeff-4d62e03cc091", "flavorRef": "452", "networks": [{"uuid": "fce77a31-1f15-466b-8f96-151c8cb7a2de"}]}} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:53:25.916019 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_api:SELECT=11 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:53:25.916743 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell1:SELECT=26,nova_cell1:INSERT=1 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:53:25.963757 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.network.neutron [None req-1182c0fb-0264-4d0a-805e-d0a89414d291 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] validate_networks() for [('fce77a31-1f15-466b-8f96-151c8cb7a2de', None, None, None, None, None)] {{(pid=119658) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:53:26.317341 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-1182c0fb-0264-4d0a-805e-d0a89414d291 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Flavor limits 0:0:0 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:53:26.317781 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-1182c0fb-0264-4d0a-805e-d0a89414d291 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Image limits 0:0:0 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:53:26.318250 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-1182c0fb-0264-4d0a-805e-d0a89414d291 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Flavor pref 0:0:0 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:53:26.318654 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-1182c0fb-0264-4d0a-805e-d0a89414d291 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Image pref 0:0:0 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:53:26.319908 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-1182c0fb-0264-4d0a-805e-d0a89414d291 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:53:26.328789 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1182c0fb-0264-4d0a-805e-d0a89414d291 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:26.329360 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1182c0fb-0264-4d0a-805e-d0a89414d291 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:26.329800 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1182c0fb-0264-4d0a-805e-d0a89414d291 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:26.330522 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1182c0fb-0264-4d0a-805e-d0a89414d291 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:26.330975 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1182c0fb-0264-4d0a-805e-d0a89414d291 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:26.331399 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-1182c0fb-0264-4d0a-805e-d0a89414d291 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:26.348928 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.quota [None req-1182c0fb-0264-4d0a-805e-d0a89414d291 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Getting quotas for project e6956385cb1846b8b02bc517a81ce1fa. Resources: {'instances', 'ram', 'cores'} {{(pid=119658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:53:26.353158 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.quota [None req-1182c0fb-0264-4d0a-805e-d0a89414d291 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Getting quotas for user 4e30582f46214d05a85f2b0542e69ed7 and project e6956385cb1846b8b02bc517a81ce1fa. Resources: {'instances', 'ram', 'cores'} {{(pid=119658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:53:26.364971 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-1182c0fb-0264-4d0a-805e-d0a89414d291 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Going to run 1 instances... {{(pid=119658) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:53:26.367938 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-1182c0fb-0264-4d0a-805e-d0a89414d291 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] [instance: 3f436b38-672d-4c0f-89da-818b4031bfce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a726a246-cc7f-46e6-aeff-4d62e03cc091',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119658) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:53:26.480990 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-1182c0fb-0264-4d0a-805e-d0a89414d291 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.579662 Nov 02 14:53:26.481668 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 525/1078] 10.222.0.30 () {60 vars in 1147 bytes} [Wed Nov 2 14:53:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:53:26.493497 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-10661521-9b65-469b-8908-5a9761caf448 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:53:26.494336 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-10661521-9b65-469b-8908-5a9761caf448 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] [instance: 3f436b38-672d-4c0f-89da-818b4031bfce] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:53:26.497230 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:53:26.497892 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:53:26.554513 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-10661521-9b65-469b-8908-5a9761caf448 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30582f46214d05a85f2b0542e69ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6956385cb1846b8b02bc517a81ce1fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:53:26.562585 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-10661521-9b65-469b-8908-5a9761caf448 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] 10.222.0.30 "GET /compute/v2.1/servers/3f436b38-672d-4c0f-89da-818b4031bfce" status: 200 len: 1219 microversion: 2.1 time: 0.073507 Nov 02 14:53:26.563155 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 554/1079] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:53:26 2022] GET /compute/v2.1/servers/3f436b38-672d-4c0f-89da-818b4031bfce => generated 1219 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:53:27.587181 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-7fece6f6-b360-459c-a98b-d5642db4b6a4 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:53:27.587788 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-7fece6f6-b360-459c-a98b-d5642db4b6a4 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] [instance: 3f436b38-672d-4c0f-89da-818b4031bfce] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:53:27.594758 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7fece6f6-b360-459c-a98b-d5642db4b6a4 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:27.600963 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7fece6f6-b360-459c-a98b-d5642db4b6a4 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:27.600963 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7fece6f6-b360-459c-a98b-d5642db4b6a4 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:27.600963 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7fece6f6-b360-459c-a98b-d5642db4b6a4 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:27.600963 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7fece6f6-b360-459c-a98b-d5642db4b6a4 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:27.601417 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7fece6f6-b360-459c-a98b-d5642db4b6a4 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:27.666024 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-7fece6f6-b360-459c-a98b-d5642db4b6a4 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30582f46214d05a85f2b0542e69ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6956385cb1846b8b02bc517a81ce1fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:53:27.675346 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-7fece6f6-b360-459c-a98b-d5642db4b6a4 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] 10.222.0.30 "GET /compute/v2.1/servers/3f436b38-672d-4c0f-89da-818b4031bfce" status: 200 len: 1223 microversion: 2.1 time: 0.091783 Nov 02 14:53:27.675346 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 526/1080] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:53:27 2022] GET /compute/v2.1/servers/3f436b38-672d-4c0f-89da-818b4031bfce => generated 1223 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:53:28.698114 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-b5b3e95b-1a74-4f42-a881-e6bf63e9a4af tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:53:28.698906 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-b5b3e95b-1a74-4f42-a881-e6bf63e9a4af tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] [instance: 3f436b38-672d-4c0f-89da-818b4031bfce] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:53:28.707592 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b5b3e95b-1a74-4f42-a881-e6bf63e9a4af tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:28.708204 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b5b3e95b-1a74-4f42-a881-e6bf63e9a4af tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:28.708535 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b5b3e95b-1a74-4f42-a881-e6bf63e9a4af tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:28.709325 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b5b3e95b-1a74-4f42-a881-e6bf63e9a4af tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:28.712305 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b5b3e95b-1a74-4f42-a881-e6bf63e9a4af tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:28.712305 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-b5b3e95b-1a74-4f42-a881-e6bf63e9a4af tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:28.775274 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-b5b3e95b-1a74-4f42-a881-e6bf63e9a4af tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30582f46214d05a85f2b0542e69ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6956385cb1846b8b02bc517a81ce1fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:53:28.782905 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-b5b3e95b-1a74-4f42-a881-e6bf63e9a4af tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] 10.222.0.30 "GET /compute/v2.1/servers/3f436b38-672d-4c0f-89da-818b4031bfce" status: 200 len: 1279 microversion: 2.1 time: 0.089873 Nov 02 14:53:28.783481 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 555/1081] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:53:28 2022] GET /compute/v2.1/servers/3f436b38-672d-4c0f-89da-818b4031bfce => generated 1279 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:53:29.806847 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-9f27af13-2b53-48c5-bf54-9caa8d761b7d tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:53:29.807398 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-9f27af13-2b53-48c5-bf54-9caa8d761b7d tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] [instance: 3f436b38-672d-4c0f-89da-818b4031bfce] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:53:29.813690 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9f27af13-2b53-48c5-bf54-9caa8d761b7d tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:29.814177 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9f27af13-2b53-48c5-bf54-9caa8d761b7d tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:29.814615 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9f27af13-2b53-48c5-bf54-9caa8d761b7d tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:29.815323 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9f27af13-2b53-48c5-bf54-9caa8d761b7d tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:29.815781 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9f27af13-2b53-48c5-bf54-9caa8d761b7d tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:29.816208 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9f27af13-2b53-48c5-bf54-9caa8d761b7d tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:29.948492 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-9f27af13-2b53-48c5-bf54-9caa8d761b7d tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30582f46214d05a85f2b0542e69ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6956385cb1846b8b02bc517a81ce1fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:53:29.956356 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-9f27af13-2b53-48c5-bf54-9caa8d761b7d tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] 10.222.0.30 "GET /compute/v2.1/servers/3f436b38-672d-4c0f-89da-818b4031bfce" status: 200 len: 1319 microversion: 2.1 time: 0.153675 Nov 02 14:53:29.956933 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 527/1082] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:53:29 2022] GET /compute/v2.1/servers/3f436b38-672d-4c0f-89da-818b4031bfce => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:53:30.378412 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [req-432978c3-94c9-42dc-b78f-3ba32efa2e94 req-7780d437-c68d-45b8-9c91-aef993b9cedc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f436b38-672d-4c0f-89da-818b4031bfce", "tag": "f2e8c5b9-c9ad-431a-bb6b-417a5f8e208a"}]} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:53:30.389675 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-432978c3-94c9-42dc-b78f-3ba32efa2e94 req-7780d437-c68d-45b8-9c91-aef993b9cedc service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:30.390237 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-432978c3-94c9-42dc-b78f-3ba32efa2e94 req-7780d437-c68d-45b8-9c91-aef993b9cedc service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:30.390721 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-432978c3-94c9-42dc-b78f-3ba32efa2e94 req-7780d437-c68d-45b8-9c91-aef993b9cedc service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:30.403868 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.compute.server_external_events [req-432978c3-94c9-42dc-b78f-3ba32efa2e94 req-7780d437-c68d-45b8-9c91-aef993b9cedc service nova] Creating event network-changed:f2e8c5b9-c9ad-431a-bb6b-417a5f8e208a for instance 3f436b38-672d-4c0f-89da-818b4031bfce on hv-cinder-86236 Nov 02 14:53:30.408853 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [req-432978c3-94c9-42dc-b78f-3ba32efa2e94 req-7780d437-c68d-45b8-9c91-aef993b9cedc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035954 Nov 02 14:53:30.409489 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 556/1083] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:53:30.987282 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-93234d09-aecf-4054-81d2-2a0704a5f282 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:53:30.987905 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-93234d09-aecf-4054-81d2-2a0704a5f282 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] [instance: 3f436b38-672d-4c0f-89da-818b4031bfce] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:53:30.994676 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-93234d09-aecf-4054-81d2-2a0704a5f282 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:30.995166 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-93234d09-aecf-4054-81d2-2a0704a5f282 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:30.995864 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-93234d09-aecf-4054-81d2-2a0704a5f282 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:30.996571 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-93234d09-aecf-4054-81d2-2a0704a5f282 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:30.997148 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-93234d09-aecf-4054-81d2-2a0704a5f282 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:30.997582 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-93234d09-aecf-4054-81d2-2a0704a5f282 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:31.132183 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-93234d09-aecf-4054-81d2-2a0704a5f282 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30582f46214d05a85f2b0542e69ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6956385cb1846b8b02bc517a81ce1fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:53:31.140102 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-93234d09-aecf-4054-81d2-2a0704a5f282 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] 10.222.0.30 "GET /compute/v2.1/servers/3f436b38-672d-4c0f-89da-818b4031bfce" status: 200 len: 1319 microversion: 2.1 time: 0.156761 Nov 02 14:53:31.140734 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 528/1084] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:53:30 2022] GET /compute/v2.1/servers/3f436b38-672d-4c0f-89da-818b4031bfce => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:53:32.165202 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-d6bcc2d4-d653-4591-beff-e68ab8113b86 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:53:32.165817 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-d6bcc2d4-d653-4591-beff-e68ab8113b86 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] [instance: 3f436b38-672d-4c0f-89da-818b4031bfce] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:53:32.172290 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d6bcc2d4-d653-4591-beff-e68ab8113b86 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:32.172775 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d6bcc2d4-d653-4591-beff-e68ab8113b86 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:32.173248 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d6bcc2d4-d653-4591-beff-e68ab8113b86 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:32.173982 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d6bcc2d4-d653-4591-beff-e68ab8113b86 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:32.174442 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d6bcc2d4-d653-4591-beff-e68ab8113b86 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:32.174890 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d6bcc2d4-d653-4591-beff-e68ab8113b86 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:32.308542 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-d6bcc2d4-d653-4591-beff-e68ab8113b86 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30582f46214d05a85f2b0542e69ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6956385cb1846b8b02bc517a81ce1fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:53:32.316412 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-d6bcc2d4-d653-4591-beff-e68ab8113b86 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] 10.222.0.30 "GET /compute/v2.1/servers/3f436b38-672d-4c0f-89da-818b4031bfce" status: 200 len: 1319 microversion: 2.1 time: 0.156336 Nov 02 14:53:32.316982 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 557/1085] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:53:32 2022] GET /compute/v2.1/servers/3f436b38-672d-4c0f-89da-818b4031bfce => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:53:33.340485 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-f8655c00-90ac-46c5-98e7-f1708db9d80a tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:53:33.341093 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-f8655c00-90ac-46c5-98e7-f1708db9d80a tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] [instance: 3f436b38-672d-4c0f-89da-818b4031bfce] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:53:33.347445 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f8655c00-90ac-46c5-98e7-f1708db9d80a tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:33.347925 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f8655c00-90ac-46c5-98e7-f1708db9d80a tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:33.348356 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f8655c00-90ac-46c5-98e7-f1708db9d80a tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:33.349066 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f8655c00-90ac-46c5-98e7-f1708db9d80a tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:33.349523 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f8655c00-90ac-46c5-98e7-f1708db9d80a tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:33.349955 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f8655c00-90ac-46c5-98e7-f1708db9d80a tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:33.493187 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-f8655c00-90ac-46c5-98e7-f1708db9d80a tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30582f46214d05a85f2b0542e69ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6956385cb1846b8b02bc517a81ce1fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:53:33.502185 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-f8655c00-90ac-46c5-98e7-f1708db9d80a tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] 10.222.0.30 "GET /compute/v2.1/servers/3f436b38-672d-4c0f-89da-818b4031bfce" status: 200 len: 1319 microversion: 2.1 time: 0.165542 Nov 02 14:53:33.502807 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 529/1086] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:53:33 2022] GET /compute/v2.1/servers/3f436b38-672d-4c0f-89da-818b4031bfce => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:53:34.525532 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-a8b3ee99-de4c-42fa-99a6-727968a6d966 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:53:34.526153 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-a8b3ee99-de4c-42fa-99a6-727968a6d966 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] [instance: 3f436b38-672d-4c0f-89da-818b4031bfce] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:53:34.532883 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a8b3ee99-de4c-42fa-99a6-727968a6d966 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:34.533401 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a8b3ee99-de4c-42fa-99a6-727968a6d966 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:34.533840 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a8b3ee99-de4c-42fa-99a6-727968a6d966 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:34.534540 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a8b3ee99-de4c-42fa-99a6-727968a6d966 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:34.535032 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a8b3ee99-de4c-42fa-99a6-727968a6d966 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:34.535456 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a8b3ee99-de4c-42fa-99a6-727968a6d966 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:34.670917 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-a8b3ee99-de4c-42fa-99a6-727968a6d966 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30582f46214d05a85f2b0542e69ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6956385cb1846b8b02bc517a81ce1fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:53:34.679834 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-a8b3ee99-de4c-42fa-99a6-727968a6d966 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] 10.222.0.30 "GET /compute/v2.1/servers/3f436b38-672d-4c0f-89da-818b4031bfce" status: 200 len: 1319 microversion: 2.1 time: 0.158635 Nov 02 14:53:34.680427 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 558/1087] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:53:34 2022] GET /compute/v2.1/servers/3f436b38-672d-4c0f-89da-818b4031bfce => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:53:35.703720 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-3a01238c-1036-4f73-93c0-8868fb13b683 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:53:35.704459 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-3a01238c-1036-4f73-93c0-8868fb13b683 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] [instance: 3f436b38-672d-4c0f-89da-818b4031bfce] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:53:35.711855 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3a01238c-1036-4f73-93c0-8868fb13b683 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:35.712358 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3a01238c-1036-4f73-93c0-8868fb13b683 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:35.712806 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3a01238c-1036-4f73-93c0-8868fb13b683 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:35.713555 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3a01238c-1036-4f73-93c0-8868fb13b683 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:35.714017 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3a01238c-1036-4f73-93c0-8868fb13b683 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:35.714448 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3a01238c-1036-4f73-93c0-8868fb13b683 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:35.852459 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-3a01238c-1036-4f73-93c0-8868fb13b683 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30582f46214d05a85f2b0542e69ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6956385cb1846b8b02bc517a81ce1fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:53:35.860327 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-3a01238c-1036-4f73-93c0-8868fb13b683 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] 10.222.0.30 "GET /compute/v2.1/servers/3f436b38-672d-4c0f-89da-818b4031bfce" status: 200 len: 1319 microversion: 2.1 time: 0.160476 Nov 02 14:53:35.860901 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 530/1088] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:53:35 2022] GET /compute/v2.1/servers/3f436b38-672d-4c0f-89da-818b4031bfce => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:53:36.048889 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [req-d1f06abe-5a97-401a-86f4-f84ac060fff7 req-d3a97a6c-23c0-4262-b619-3acfb6f064b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f436b38-672d-4c0f-89da-818b4031bfce", "name": "network-vif-plugged", "status": "completed", "tag": "f2e8c5b9-c9ad-431a-bb6b-417a5f8e208a"}]} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:53:36.059176 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-d1f06abe-5a97-401a-86f4-f84ac060fff7 req-d3a97a6c-23c0-4262-b619-3acfb6f064b3 service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:36.059660 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-d1f06abe-5a97-401a-86f4-f84ac060fff7 req-d3a97a6c-23c0-4262-b619-3acfb6f064b3 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:36.060094 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-d1f06abe-5a97-401a-86f4-f84ac060fff7 req-d3a97a6c-23c0-4262-b619-3acfb6f064b3 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:36.072151 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.compute.server_external_events [req-d1f06abe-5a97-401a-86f4-f84ac060fff7 req-d3a97a6c-23c0-4262-b619-3acfb6f064b3 service nova] Creating event network-vif-plugged:f2e8c5b9-c9ad-431a-bb6b-417a5f8e208a for instance 3f436b38-672d-4c0f-89da-818b4031bfce on hv-cinder-86236 Nov 02 14:53:36.077349 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [req-d1f06abe-5a97-401a-86f4-f84ac060fff7 req-d3a97a6c-23c0-4262-b619-3acfb6f064b3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032725 Nov 02 14:53:36.077971 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 559/1089] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:53:36.885268 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-cd7c7fa5-1715-4d2a-b090-d6f55883417b tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:53:36.885881 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-cd7c7fa5-1715-4d2a-b090-d6f55883417b tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] [instance: 3f436b38-672d-4c0f-89da-818b4031bfce] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:53:36.887819 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell0:SELECT=2 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:53:36.888485 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell0:SELECT=6 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:53:36.894193 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-cd7c7fa5-1715-4d2a-b090-d6f55883417b tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:36.894687 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-cd7c7fa5-1715-4d2a-b090-d6f55883417b tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:36.895125 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-cd7c7fa5-1715-4d2a-b090-d6f55883417b tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:36.895865 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-cd7c7fa5-1715-4d2a-b090-d6f55883417b tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:36.896330 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-cd7c7fa5-1715-4d2a-b090-d6f55883417b tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:36.896805 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-cd7c7fa5-1715-4d2a-b090-d6f55883417b tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:37.034374 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-cd7c7fa5-1715-4d2a-b090-d6f55883417b tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30582f46214d05a85f2b0542e69ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6956385cb1846b8b02bc517a81ce1fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:53:37.042262 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-cd7c7fa5-1715-4d2a-b090-d6f55883417b tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] 10.222.0.30 "GET /compute/v2.1/servers/3f436b38-672d-4c0f-89da-818b4031bfce" status: 200 len: 1319 microversion: 2.1 time: 0.161581 Nov 02 14:53:37.042826 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 531/1090] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:53:36 2022] GET /compute/v2.1/servers/3f436b38-672d-4c0f-89da-818b4031bfce => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:53:38.062808 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell0:SELECT=2 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:53:38.067655 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-cfc68957-2929-4ce0-ada6-2fc05d4c688d tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:53:38.068361 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-cfc68957-2929-4ce0-ada6-2fc05d4c688d tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] [instance: 3f436b38-672d-4c0f-89da-818b4031bfce] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:53:38.075754 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-cfc68957-2929-4ce0-ada6-2fc05d4c688d tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:38.076371 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-cfc68957-2929-4ce0-ada6-2fc05d4c688d tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:38.076844 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-cfc68957-2929-4ce0-ada6-2fc05d4c688d tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:38.077580 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-cfc68957-2929-4ce0-ada6-2fc05d4c688d tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:38.078069 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-cfc68957-2929-4ce0-ada6-2fc05d4c688d tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:38.078499 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-cfc68957-2929-4ce0-ada6-2fc05d4c688d tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:38.213756 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-cfc68957-2929-4ce0-ada6-2fc05d4c688d tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30582f46214d05a85f2b0542e69ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6956385cb1846b8b02bc517a81ce1fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:53:38.221545 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-cfc68957-2929-4ce0-ada6-2fc05d4c688d tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] 10.222.0.30 "GET /compute/v2.1/servers/3f436b38-672d-4c0f-89da-818b4031bfce" status: 200 len: 1508 microversion: 2.1 time: 0.159739 Nov 02 14:53:38.222115 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 560/1091] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:53:38 2022] GET /compute/v2.1/servers/3f436b38-672d-4c0f-89da-818b4031bfce => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:53:38.244148 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-b380e4a6-7d85-47c4-9a12-056c4c3fa094 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0710d018-7783-4228-ba53-7723383fbe75", "device": "/dev/sdb"}} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:53:38.247438 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-b380e4a6-7d85-47c4-9a12-056c4c3fa094 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] [instance: 3f436b38-672d-4c0f-89da-818b4031bfce] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:53:38.254415 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b380e4a6-7d85-47c4-9a12-056c4c3fa094 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:38.254898 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b380e4a6-7d85-47c4-9a12-056c4c3fa094 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:38.255337 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b380e4a6-7d85-47c4-9a12-056c4c3fa094 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:38.256552 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b380e4a6-7d85-47c4-9a12-056c4c3fa094 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:38.256981 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b380e4a6-7d85-47c4-9a12-056c4c3fa094 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:38.257439 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b380e4a6-7d85-47c4-9a12-056c4c3fa094 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:39.220010 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-b380e4a6-7d85-47c4-9a12-056c4c3fa094 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] 10.222.0.30 "POST /compute/v2.1/servers/3f436b38-672d-4c0f-89da-818b4031bfce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.979782 Nov 02 14:53:39.220639 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 532/1092] 10.222.0.30 () {60 vars in 1323 bytes} [Wed Nov 2 14:53:38 2022] POST /compute/v2.1/servers/3f436b38-672d-4c0f-89da-818b4031bfce/os-volume_attachments => generated 194 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:53:59.380406 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-56b0527c-eaa0-4d53-8e25-62b060758029 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:53:59.380940 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-56b0527c-eaa0-4d53-8e25-62b060758029 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] [instance: 3f436b38-672d-4c0f-89da-818b4031bfce] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:53:59.382943 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_api:SELECT=16 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:53:59.383655 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell1:SELECT=28 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:53:59.389179 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-56b0527c-eaa0-4d53-8e25-62b060758029 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:59.389715 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-56b0527c-eaa0-4d53-8e25-62b060758029 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:59.390142 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-56b0527c-eaa0-4d53-8e25-62b060758029 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:59.390828 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-56b0527c-eaa0-4d53-8e25-62b060758029 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:59.391273 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-56b0527c-eaa0-4d53-8e25-62b060758029 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:59.391691 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-56b0527c-eaa0-4d53-8e25-62b060758029 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:59.476591 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.objects.instance [None req-56b0527c-eaa0-4d53-8e25-62b060758029 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lazy-loading 'services' on Instance uuid 3f436b38-672d-4c0f-89da-818b4031bfce {{(pid=119659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:53:59.723355 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-56b0527c-eaa0-4d53-8e25-62b060758029 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3f436b38-672d-4c0f-89da-818b4031bfce/os-volume_attachments/0710d018-7783-4228-ba53-7723383fbe75" status: 202 len: 0 microversion: 2.1 time: 0.346763 Nov 02 14:53:59.723932 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 561/1093] 10.222.0.30 () {58 vars in 1416 bytes} [Wed Nov 2 14:53:59 2022] DELETE /compute/v2.1/servers/3f436b38-672d-4c0f-89da-818b4031bfce/os-volume_attachments/0710d018-7783-4228-ba53-7723383fbe75 => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:54:00.851441 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:54:00.852278 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:54:00.857546 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-9e723f28-87b4-46d9-940c-85916185a2f5 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:54:00.858320 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-9e723f28-87b4-46d9-940c-85916185a2f5 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] [instance: 3f436b38-672d-4c0f-89da-818b4031bfce] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:54:00.864213 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9e723f28-87b4-46d9-940c-85916185a2f5 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:00.864732 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9e723f28-87b4-46d9-940c-85916185a2f5 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:00.865208 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9e723f28-87b4-46d9-940c-85916185a2f5 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:00.865913 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9e723f28-87b4-46d9-940c-85916185a2f5 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:00.866372 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9e723f28-87b4-46d9-940c-85916185a2f5 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:00.866810 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-9e723f28-87b4-46d9-940c-85916185a2f5 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:00.896257 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-9e723f28-87b4-46d9-940c-85916185a2f5 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] [instance: 3f436b38-672d-4c0f-89da-818b4031bfce] Going to try to terminate instance {{(pid=119658) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:54:01.199223 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-9e723f28-87b4-46d9-940c-85916185a2f5 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3f436b38-672d-4c0f-89da-818b4031bfce" status: 204 len: 0 microversion: 2.1 time: 0.348899 Nov 02 14:54:01.199869 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 533/1094] 10.222.0.30 () {58 vars in 1239 bytes} [Wed Nov 2 14:54:00 2022] DELETE /compute/v2.1/servers/3f436b38-672d-4c0f-89da-818b4031bfce => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:54:01.209238 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-4d0ca4b8-6990-4b3e-a241-ed135e02d680 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:54:01.209940 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-4d0ca4b8-6990-4b3e-a241-ed135e02d680 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] [instance: 3f436b38-672d-4c0f-89da-818b4031bfce] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:54:01.217171 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4d0ca4b8-6990-4b3e-a241-ed135e02d680 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:01.217657 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4d0ca4b8-6990-4b3e-a241-ed135e02d680 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:01.218096 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4d0ca4b8-6990-4b3e-a241-ed135e02d680 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:01.218827 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4d0ca4b8-6990-4b3e-a241-ed135e02d680 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:01.219271 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4d0ca4b8-6990-4b3e-a241-ed135e02d680 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:01.219688 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4d0ca4b8-6990-4b3e-a241-ed135e02d680 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:01.356974 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-4d0ca4b8-6990-4b3e-a241-ed135e02d680 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30582f46214d05a85f2b0542e69ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6956385cb1846b8b02bc517a81ce1fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:54:01.365266 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-4d0ca4b8-6990-4b3e-a241-ed135e02d680 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] 10.222.0.30 "GET /compute/v2.1/servers/3f436b38-672d-4c0f-89da-818b4031bfce" status: 200 len: 1514 microversion: 2.1 time: 0.160766 Nov 02 14:54:01.365845 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 562/1095] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:54:01 2022] GET /compute/v2.1/servers/3f436b38-672d-4c0f-89da-818b4031bfce => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:54:02.390032 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-52cbd6c7-c967-4343-9d32-a9380e88299a tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:54:02.390726 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-52cbd6c7-c967-4343-9d32-a9380e88299a tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] [instance: 3f436b38-672d-4c0f-89da-818b4031bfce] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:54:02.398062 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-52cbd6c7-c967-4343-9d32-a9380e88299a tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:02.398542 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-52cbd6c7-c967-4343-9d32-a9380e88299a tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:02.398979 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-52cbd6c7-c967-4343-9d32-a9380e88299a tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:02.399678 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-52cbd6c7-c967-4343-9d32-a9380e88299a tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:02.400148 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-52cbd6c7-c967-4343-9d32-a9380e88299a tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:02.400571 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-52cbd6c7-c967-4343-9d32-a9380e88299a tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:02.532337 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-52cbd6c7-c967-4343-9d32-a9380e88299a tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30582f46214d05a85f2b0542e69ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6956385cb1846b8b02bc517a81ce1fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:54:02.540431 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-52cbd6c7-c967-4343-9d32-a9380e88299a tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] 10.222.0.30 "GET /compute/v2.1/servers/3f436b38-672d-4c0f-89da-818b4031bfce" status: 200 len: 1514 microversion: 2.1 time: 0.155102 Nov 02 14:54:02.541039 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 534/1096] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:54:02 2022] GET /compute/v2.1/servers/3f436b38-672d-4c0f-89da-818b4031bfce => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:54:03.564826 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-f8730399-7ac0-49e5-8233-3a255b9f69e8 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:54:03.565395 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-f8730399-7ac0-49e5-8233-3a255b9f69e8 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] [instance: 3f436b38-672d-4c0f-89da-818b4031bfce] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:54:03.572531 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f8730399-7ac0-49e5-8233-3a255b9f69e8 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:03.572867 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f8730399-7ac0-49e5-8233-3a255b9f69e8 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:03.573341 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f8730399-7ac0-49e5-8233-3a255b9f69e8 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:03.574208 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f8730399-7ac0-49e5-8233-3a255b9f69e8 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:03.574688 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f8730399-7ac0-49e5-8233-3a255b9f69e8 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:03.575120 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-f8730399-7ac0-49e5-8233-3a255b9f69e8 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:03.711604 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-f8730399-7ac0-49e5-8233-3a255b9f69e8 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30582f46214d05a85f2b0542e69ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6956385cb1846b8b02bc517a81ce1fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:54:03.721572 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-f8730399-7ac0-49e5-8233-3a255b9f69e8 tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] 10.222.0.30 "GET /compute/v2.1/servers/3f436b38-672d-4c0f-89da-818b4031bfce" status: 200 len: 1514 microversion: 2.1 time: 0.161026 Nov 02 14:54:03.733198 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 563/1097] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:54:03 2022] GET /compute/v2.1/servers/3f436b38-672d-4c0f-89da-818b4031bfce => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:54:03.733412 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [req-7d02627d-f9db-40f7-ba56-06e2940246d0 req-d24aa44c-bcd4-43d5-89cd-42a9394013a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f436b38-672d-4c0f-89da-818b4031bfce", "name": "network-vif-deleted", "tag": "f2e8c5b9-c9ad-431a-bb6b-417a5f8e208a"}]} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:54:03.740037 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-7d02627d-f9db-40f7-ba56-06e2940246d0 req-d24aa44c-bcd4-43d5-89cd-42a9394013a7 service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:03.740526 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-7d02627d-f9db-40f7-ba56-06e2940246d0 req-d24aa44c-bcd4-43d5-89cd-42a9394013a7 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:03.740957 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-7d02627d-f9db-40f7-ba56-06e2940246d0 req-d24aa44c-bcd4-43d5-89cd-42a9394013a7 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:03.752484 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.compute.server_external_events [req-7d02627d-f9db-40f7-ba56-06e2940246d0 req-d24aa44c-bcd4-43d5-89cd-42a9394013a7 service nova] Creating event network-vif-deleted:f2e8c5b9-c9ad-431a-bb6b-417a5f8e208a for instance 3f436b38-672d-4c0f-89da-818b4031bfce on hv-cinder-86236 Nov 02 14:54:03.757334 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [req-7d02627d-f9db-40f7-ba56-06e2940246d0 req-d24aa44c-bcd4-43d5-89cd-42a9394013a7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031772 Nov 02 14:54:03.758001 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 535/1098] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:54:04.747424 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-6a96786b-d116-4c4f-826d-0cb7d09456bd tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:54:04.749116 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-6a96786b-d116-4c4f-826d-0cb7d09456bd tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] [instance: 3f436b38-672d-4c0f-89da-818b4031bfce] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:54:04.754681 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6a96786b-d116-4c4f-826d-0cb7d09456bd tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:04.755157 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6a96786b-d116-4c4f-826d-0cb7d09456bd tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:04.755661 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6a96786b-d116-4c4f-826d-0cb7d09456bd tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:04.756357 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6a96786b-d116-4c4f-826d-0cb7d09456bd tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:04.756799 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6a96786b-d116-4c4f-826d-0cb7d09456bd tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:04.757254 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6a96786b-d116-4c4f-826d-0cb7d09456bd tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:04.790020 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6a96786b-d116-4c4f-826d-0cb7d09456bd tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:04.790407 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6a96786b-d116-4c4f-826d-0cb7d09456bd tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:04.790835 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-6a96786b-d116-4c4f-826d-0cb7d09456bd tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:04.791279 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.objects.instance [None req-6a96786b-d116-4c4f-826d-0cb7d09456bd tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lazy-loading 'fault' on Instance uuid 3f436b38-672d-4c0f-89da-818b4031bfce {{(pid=119659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:54:04.835850 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-6a96786b-d116-4c4f-826d-0cb7d09456bd tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30582f46214d05a85f2b0542e69ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6956385cb1846b8b02bc517a81ce1fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:54:04.843619 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-6a96786b-d116-4c4f-826d-0cb7d09456bd tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] 10.222.0.30 "GET /compute/v2.1/servers/3f436b38-672d-4c0f-89da-818b4031bfce" status: 200 len: 1309 microversion: 2.1 time: 0.101075 Nov 02 14:54:04.844178 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 564/1099] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:54:04 2022] GET /compute/v2.1/servers/3f436b38-672d-4c0f-89da-818b4031bfce => generated 1309 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:54:05.872987 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-895ff4bf-446b-4f57-a772-229456e380ff tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:54:05.873706 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-895ff4bf-446b-4f57-a772-229456e380ff tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] [instance: 3f436b38-672d-4c0f-89da-818b4031bfce] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:54:05.880818 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-895ff4bf-446b-4f57-a772-229456e380ff tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:05.881336 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-895ff4bf-446b-4f57-a772-229456e380ff tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:05.881777 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-895ff4bf-446b-4f57-a772-229456e380ff tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:05.882478 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-895ff4bf-446b-4f57-a772-229456e380ff tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:05.882934 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-895ff4bf-446b-4f57-a772-229456e380ff tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:05.883365 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-895ff4bf-446b-4f57-a772-229456e380ff tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:05.897649 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.wsgi [None req-895ff4bf-446b-4f57-a772-229456e380ff tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] HTTP exception thrown: Instance 3f436b38-672d-4c0f-89da-818b4031bfce could not be found. Nov 02 14:54:05.899315 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-895ff4bf-446b-4f57-a772-229456e380ff tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Request method failure captured: Nov 02 14:54:05.899315 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: request: GET /compute/v2.1/servers/3f436b38-672d-4c0f-89da-818b4031bfce HTTP/1.1 Nov 02 14:54:05.899315 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Accept: application/json Nov 02 14:54:05.899315 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Accept-Encoding: identity Nov 02 14:54:05.899315 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Connection: close Nov 02 14:54:05.899315 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Content-Length: 0 Nov 02 14:54:05.899315 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Content-Type: application/json Nov 02 14:54:05.899315 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Host: 10.222.0.30 Nov 02 14:54:05.899315 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Openstack-System-Scope: None Nov 02 14:54:05.899315 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: User-Agent: python-urllib3/1.26.12 Nov 02 14:54:05.899315 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Auth-Token: gAAAAABjYoQbjhuCm9MRO8zcC3UBcUGkA2dL3RqhD2uaW6wM70qcUoo5NcGLJpEieVx4w6uIWUaZ7nYeTFix8idNvwnYeyp5EV8uNIPeST6nwvH4u9aCv3p0N5bnqXrtOlO0VKbM8Uuwu-JLQmyq1F078p_rANl44m5CLQ_Y13yhXaNZg9abvno Nov 02 14:54:05.899315 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Domain-Id: None Nov 02 14:54:05.899315 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Domain-Name: None Nov 02 14:54:05.899315 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Identity-Status: Confirmed Nov 02 14:54:05.899315 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Is-Admin-Project: True Nov 02 14:54:05.899315 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Domain-Id: default Nov 02 14:54:05.899315 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Domain-Name: Default Nov 02 14:54:05.899315 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Id: e6956385cb1846b8b02bc517a81ce1fa Nov 02 14:54:05.899315 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1938961982 Nov 02 14:54:05.899315 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Role: reader,member Nov 02 14:54:05.899315 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Roles: reader,member Nov 02 14:54:05.901263 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e6956385cb1846b8b02bc517a81ce1fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e6956385cb1846b8b02bc517a81ce1fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e6956385cb1846b8b02bc517a81ce1fa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e6956385cb1846b8b02bc517a81ce1fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:54:05.901263 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant: tempest-VolumesSnapshotTestJSON-1938961982 Nov 02 14:54:05.901263 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant-Id: e6956385cb1846b8b02bc517a81ce1fa Nov 02 14:54:05.901263 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1938961982 Nov 02 14:54:05.901263 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User: tempest-VolumesSnapshotTestJSON-1938961982-project Nov 02 14:54:05.901263 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Domain-Id: default Nov 02 14:54:05.901263 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Domain-Name: Default Nov 02 14:54:05.901263 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Id: 4e30582f46214d05a85f2b0542e69ed7 Nov 02 14:54:05.901263 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: X-User-Name: tempest-VolumesSnapshotTestJSON-1938961982-project Nov 02 14:54:05.901263 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: method: > Nov 02 14:54:05.901263 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: exception: Instance 3f436b38-672d-4c0f-89da-818b4031bfce could not be found. Nov 02 14:54:05.901263 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: action_args: {'id': '3f436b38-672d-4c0f-89da-818b4031bfce'} Nov 02 14:54:05.902194 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:54:05.902194 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:54:05.902194 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:54:05.902194 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:54:05.902194 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:54:05.902194 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:54:05.902194 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:54:05.902194 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:54:05.902194 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:54:05.902194 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:54:05.902194 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f436b38-672d-4c0f-89da-818b4031bfce could not be found. Nov 02 14:54:05.902194 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:54:05.902194 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:54:05.902194 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:54:05.902194 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:54:05.902194 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:54:05.902194 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:54:05.902194 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:54:05.902194 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:54:05.902194 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:54:05.903559 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:54:05.903559 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:54:05.903559 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:54:05.903559 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:54:05.903559 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:54:05.903559 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:54:05.903559 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:54:05.903559 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f436b38-672d-4c0f-89da-818b4031bfce could not be found. Nov 02 14:54:05.903559 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:54:05.903559 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:54:05.903559 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:54:05.903559 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:54:05.903559 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:54:05.903559 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:54:05.903559 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:54:05.903559 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:54:05.903559 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f436b38-672d-4c0f-89da-818b4031bfce could not be found. Nov 02 14:54:05.903559 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: ERROR nova.api.openstack.wsgi Nov 02 14:54:05.904933 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-895ff4bf-446b-4f57-a772-229456e380ff tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] Returning 404 to user: Instance 3f436b38-672d-4c0f-89da-818b4031bfce could not be found. {{(pid=119658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:54:05.904933 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-895ff4bf-446b-4f57-a772-229456e380ff tempest-VolumesSnapshotTestJSON-1938961982 tempest-VolumesSnapshotTestJSON-1938961982-project] 10.222.0.30 "GET /compute/v2.1/servers/3f436b38-672d-4c0f-89da-818b4031bfce" status: 404 len: 111 microversion: 2.1 time: 0.032745 Nov 02 14:54:05.904933 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 536/1100] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:54:05 2022] GET /compute/v2.1/servers/3f436b38-672d-4c0f-89da-818b4031bfce => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:54:47.542253 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_api:SELECT=10 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:54:47.543110 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:54:47.715582 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-704740de-119a-437b-867f-c69a00cfad78 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Action: 'create', calling method: .version_select at 0x7fb24ef41670>, body: {"keypair": {"name": "tempest-TestShelveInstance-2067260031", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8ijWPAYkqt0djjmKRAjSJLEkvE0up/Z8e0ndusg9dThZlJeeafM299n2wzIuWKHNRLgoGsgQHTf0SiuowIfsy/UhZlhc13ed2nMLrcUpl4/2HdVtbkoUGLYmo7qx+7tQ=="}} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:54:47.730893 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.quota [None req-704740de-119a-437b-867f-c69a00cfad78 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Getting quotas for project b7940a345a7c4ccba03eff0476e82d6c. Resources: {'key_pairs'} {{(pid=119659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:54:47.734730 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.quota [None req-704740de-119a-437b-867f-c69a00cfad78 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Getting quotas for user e5e2a8a810804aceb641c1bd752f35e3 and project b7940a345a7c4ccba03eff0476e82d6c. Resources: {'key_pairs'} {{(pid=119659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:54:47.749906 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR oslo.messaging._drivers.impl_rabbit [None req-704740de-119a-437b-867f-c69a00cfad78 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] [c5c4f5ec-1105-44a0-8482-139bf096d7b2] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 14:54:48.758490 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO oslo.messaging._drivers.impl_rabbit [None req-704740de-119a-437b-867f-c69a00cfad78 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] [c5c4f5ec-1105-44a0-8482-139bf096d7b2] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 39862. Nov 02 14:54:48.860948 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-704740de-119a-437b-867f-c69a00cfad78 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 1.323664 Nov 02 14:54:48.861583 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 565/1101] 10.222.0.30 () {60 vars in 1159 bytes} [Wed Nov 2 14:54:47 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:55:07.926233 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:55:07.926967 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:55:07.931242 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-b4eeea55-56e6-436f-857c-261669de4de2 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-297458053", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2067260031", "security_groups": [{"name": "tempest-secgroup-smoke-1827728090"}], "networks": [{"uuid": "1cd281c7-4441-49e5-b5fc-ef9a7b818c4f"}], "block_device_mapping_v2": [{"uuid": "dcdbeef3-1dcc-4a16-b9ba-036925a242dd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:55:08.147694 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.network.neutron [None req-b4eeea55-56e6-436f-857c-261669de4de2 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] validate_networks() for [('1cd281c7-4441-49e5-b5fc-ef9a7b818c4f', None, None, None, None, None)] {{(pid=119658) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:55:08.518153 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-b4eeea55-56e6-436f-857c-261669de4de2 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Flavor limits 0:0:0 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:55:08.518579 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-b4eeea55-56e6-436f-857c-261669de4de2 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Image limits 0:0:0 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:55:08.519054 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-b4eeea55-56e6-436f-857c-261669de4de2 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Flavor pref 0:0:0 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:55:08.519491 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-b4eeea55-56e6-436f-857c-261669de4de2 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Image pref 0:0:0 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:55:08.519939 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.virt.hardware [None req-b4eeea55-56e6-436f-857c-261669de4de2 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:55:08.529543 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b4eeea55-56e6-436f-857c-261669de4de2 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:08.530023 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b4eeea55-56e6-436f-857c-261669de4de2 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:08.530461 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b4eeea55-56e6-436f-857c-261669de4de2 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:08.531191 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b4eeea55-56e6-436f-857c-261669de4de2 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:08.531653 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b4eeea55-56e6-436f-857c-261669de4de2 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:08.532077 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-b4eeea55-56e6-436f-857c-261669de4de2 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:08.549163 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.quota [None req-b4eeea55-56e6-436f-857c-261669de4de2 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Getting quotas for project b7940a345a7c4ccba03eff0476e82d6c. Resources: {'instances', 'ram', 'cores'} {{(pid=119658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:55:08.553476 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.quota [None req-b4eeea55-56e6-436f-857c-261669de4de2 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Getting quotas for user e5e2a8a810804aceb641c1bd752f35e3 and project b7940a345a7c4ccba03eff0476e82d6c. Resources: {'instances', 'ram', 'cores'} {{(pid=119658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:55:08.611638 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-b4eeea55-56e6-436f-857c-261669de4de2 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Going to run 1 instances... {{(pid=119658) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:55:08.613913 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-b4eeea55-56e6-436f-857c-261669de4de2 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] [instance: 96021548-cde6-43f8-a4c2-4da1416b6bfd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dcdbeef3-1dcc-4a16-b9ba-036925a242dd',volume_size=None,volume_type=None)] {{(pid=119658) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:55:09.068106 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-b4eeea55-56e6-436f-857c-261669de4de2 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.143738 Nov 02 14:55:09.069578 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 537/1102] 10.222.0.30 () {60 vars in 1147 bytes} [Wed Nov 2 14:55:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 1145 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:55:09.080286 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-ad90f53a-9b48-464e-baab-eb5e41d1d653 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:09.080931 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-ad90f53a-9b48-464e-baab-eb5e41d1d653 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] [instance: 96021548-cde6-43f8-a4c2-4da1416b6bfd] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:09.083468 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 14:55:09.083613 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Wed Nov 2 14:55:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd (ip 10.222.0.30) !!! Nov 02 14:55:09.084832 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell0:SELECT=4 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:55:09.086264 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:55:09.256504 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-ad90f53a-9b48-464e-baab-eb5e41d1d653 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e2a8a810804aceb641c1bd752f35e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7940a345a7c4ccba03eff0476e82d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:09.264301 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-ad90f53a-9b48-464e-baab-eb5e41d1d653 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] 10.222.0.30 "GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd" status: 200 len: 1088 microversion: 2.1 time: 0.187926 Nov 02 14:55:09.272893 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 566/1103] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:55:09 2022] GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd => generated 1088 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:10.287851 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-42387393-9b85-460c-bbec-585bcae71174 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:10.288506 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-42387393-9b85-460c-bbec-585bcae71174 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] [instance: 96021548-cde6-43f8-a4c2-4da1416b6bfd] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:10.342246 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-42387393-9b85-460c-bbec-585bcae71174 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e2a8a810804aceb641c1bd752f35e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7940a345a7c4ccba03eff0476e82d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:10.349249 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-42387393-9b85-460c-bbec-585bcae71174 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] 10.222.0.30 "GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd" status: 200 len: 1088 microversion: 2.1 time: 0.065423 Nov 02 14:55:10.349834 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 538/1104] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:55:10 2022] GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd => generated 1088 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:11.373680 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-d02d994f-0035-4ed9-9f39-41f226baa62d tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:11.374292 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-d02d994f-0035-4ed9-9f39-41f226baa62d tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] [instance: 96021548-cde6-43f8-a4c2-4da1416b6bfd] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:11.380672 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d02d994f-0035-4ed9-9f39-41f226baa62d tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:11.381182 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d02d994f-0035-4ed9-9f39-41f226baa62d tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:11.381624 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d02d994f-0035-4ed9-9f39-41f226baa62d tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:11.382309 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d02d994f-0035-4ed9-9f39-41f226baa62d tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:11.382784 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d02d994f-0035-4ed9-9f39-41f226baa62d tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:11.383205 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-d02d994f-0035-4ed9-9f39-41f226baa62d tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:11.444632 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-d02d994f-0035-4ed9-9f39-41f226baa62d tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e2a8a810804aceb641c1bd752f35e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7940a345a7c4ccba03eff0476e82d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:11.452421 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-d02d994f-0035-4ed9-9f39-41f226baa62d tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] 10.222.0.30 "GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd" status: 200 len: 1186 microversion: 2.1 time: 0.083626 Nov 02 14:55:11.452987 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 567/1105] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:55:11 2022] GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd => generated 1186 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:12.475519 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-f5d64ac6-b0fe-4520-b97b-d7bda9abed07 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:12.476089 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-f5d64ac6-b0fe-4520-b97b-d7bda9abed07 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] [instance: 96021548-cde6-43f8-a4c2-4da1416b6bfd] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:12.483894 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f5d64ac6-b0fe-4520-b97b-d7bda9abed07 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:12.484394 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f5d64ac6-b0fe-4520-b97b-d7bda9abed07 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:12.484841 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f5d64ac6-b0fe-4520-b97b-d7bda9abed07 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:12.485587 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f5d64ac6-b0fe-4520-b97b-d7bda9abed07 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:12.486052 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f5d64ac6-b0fe-4520-b97b-d7bda9abed07 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:12.486487 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f5d64ac6-b0fe-4520-b97b-d7bda9abed07 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:12.552015 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-f5d64ac6-b0fe-4520-b97b-d7bda9abed07 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e2a8a810804aceb641c1bd752f35e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7940a345a7c4ccba03eff0476e82d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:12.560601 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-f5d64ac6-b0fe-4520-b97b-d7bda9abed07 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] 10.222.0.30 "GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd" status: 200 len: 1204 microversion: 2.1 time: 0.089052 Nov 02 14:55:12.561217 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 539/1106] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:55:12 2022] GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd => generated 1204 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:13.584247 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-c8b27d4d-c60d-4e0b-8cf0-933766784573 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:13.584835 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-c8b27d4d-c60d-4e0b-8cf0-933766784573 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] [instance: 96021548-cde6-43f8-a4c2-4da1416b6bfd] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:13.591884 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c8b27d4d-c60d-4e0b-8cf0-933766784573 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:13.592386 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c8b27d4d-c60d-4e0b-8cf0-933766784573 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:13.592824 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c8b27d4d-c60d-4e0b-8cf0-933766784573 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:13.593552 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c8b27d4d-c60d-4e0b-8cf0-933766784573 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:13.594001 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c8b27d4d-c60d-4e0b-8cf0-933766784573 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:13.594468 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c8b27d4d-c60d-4e0b-8cf0-933766784573 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:13.736585 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-c8b27d4d-c60d-4e0b-8cf0-933766784573 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e2a8a810804aceb641c1bd752f35e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7940a345a7c4ccba03eff0476e82d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:13.744379 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-c8b27d4d-c60d-4e0b-8cf0-933766784573 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] 10.222.0.30 "GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd" status: 200 len: 1272 microversion: 2.1 time: 0.164109 Nov 02 14:55:13.745291 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 568/1107] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:55:13 2022] GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd => generated 1272 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:13.980902 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [req-9bce10f5-d085-45f6-bdcb-fd8bfaa12cfc req-9a96341a-982b-4584-80f5-f5ef4b532c76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96021548-cde6-43f8-a4c2-4da1416b6bfd", "tag": "f268e93c-fd04-4d6b-809f-68b16158c800"}]} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:55:13.991613 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-9bce10f5-d085-45f6-bdcb-fd8bfaa12cfc req-9a96341a-982b-4584-80f5-f5ef4b532c76 service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:13.992103 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-9bce10f5-d085-45f6-bdcb-fd8bfaa12cfc req-9a96341a-982b-4584-80f5-f5ef4b532c76 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:13.992546 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-9bce10f5-d085-45f6-bdcb-fd8bfaa12cfc req-9a96341a-982b-4584-80f5-f5ef4b532c76 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:14.005057 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.compute.server_external_events [req-9bce10f5-d085-45f6-bdcb-fd8bfaa12cfc req-9a96341a-982b-4584-80f5-f5ef4b532c76 service nova] Creating event network-changed:f268e93c-fd04-4d6b-809f-68b16158c800 for instance 96021548-cde6-43f8-a4c2-4da1416b6bfd on hv-cinder-86236 Nov 02 14:55:14.010229 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [req-9bce10f5-d085-45f6-bdcb-fd8bfaa12cfc req-9a96341a-982b-4584-80f5-f5ef4b532c76 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034343 Nov 02 14:55:14.010897 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 540/1108] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:55:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:55:14.768517 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-ff0c60b4-e6eb-4a9e-a98b-c75a1130836e tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:14.769527 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-ff0c60b4-e6eb-4a9e-a98b-c75a1130836e tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] [instance: 96021548-cde6-43f8-a4c2-4da1416b6bfd] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:14.776382 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ff0c60b4-e6eb-4a9e-a98b-c75a1130836e tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:14.776945 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ff0c60b4-e6eb-4a9e-a98b-c75a1130836e tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:14.777435 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ff0c60b4-e6eb-4a9e-a98b-c75a1130836e tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:14.778115 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ff0c60b4-e6eb-4a9e-a98b-c75a1130836e tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:14.778566 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ff0c60b4-e6eb-4a9e-a98b-c75a1130836e tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:14.779006 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ff0c60b4-e6eb-4a9e-a98b-c75a1130836e tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:14.916554 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-ff0c60b4-e6eb-4a9e-a98b-c75a1130836e tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e2a8a810804aceb641c1bd752f35e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7940a345a7c4ccba03eff0476e82d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:14.924318 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-ff0c60b4-e6eb-4a9e-a98b-c75a1130836e tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] 10.222.0.30 "GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd" status: 200 len: 1260 microversion: 2.1 time: 0.160244 Nov 02 14:55:14.924893 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 569/1109] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:55:14 2022] GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:55:15.948937 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-4827c0cf-b176-45bf-a830-0ea131f3a71c tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:15.949667 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-4827c0cf-b176-45bf-a830-0ea131f3a71c tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] [instance: 96021548-cde6-43f8-a4c2-4da1416b6bfd] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:15.956418 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4827c0cf-b176-45bf-a830-0ea131f3a71c tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:15.956910 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4827c0cf-b176-45bf-a830-0ea131f3a71c tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:15.957376 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4827c0cf-b176-45bf-a830-0ea131f3a71c tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:15.958068 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4827c0cf-b176-45bf-a830-0ea131f3a71c tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:15.958522 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4827c0cf-b176-45bf-a830-0ea131f3a71c tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:15.958951 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-4827c0cf-b176-45bf-a830-0ea131f3a71c tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:16.096871 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-4827c0cf-b176-45bf-a830-0ea131f3a71c tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e2a8a810804aceb641c1bd752f35e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7940a345a7c4ccba03eff0476e82d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:16.104680 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-4827c0cf-b176-45bf-a830-0ea131f3a71c tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] 10.222.0.30 "GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd" status: 200 len: 1260 microversion: 2.1 time: 0.160886 Nov 02 14:55:16.105359 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 541/1110] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:55:15 2022] GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:17.128638 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-fa5c85c9-d326-4e5b-9736-89d30037e37f tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:17.129264 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-fa5c85c9-d326-4e5b-9736-89d30037e37f tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] [instance: 96021548-cde6-43f8-a4c2-4da1416b6bfd] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:17.135406 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fa5c85c9-d326-4e5b-9736-89d30037e37f tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:17.135885 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fa5c85c9-d326-4e5b-9736-89d30037e37f tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:17.136328 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fa5c85c9-d326-4e5b-9736-89d30037e37f tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:17.137035 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fa5c85c9-d326-4e5b-9736-89d30037e37f tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:17.137483 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fa5c85c9-d326-4e5b-9736-89d30037e37f tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:17.137902 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-fa5c85c9-d326-4e5b-9736-89d30037e37f tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:17.269341 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-fa5c85c9-d326-4e5b-9736-89d30037e37f tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e2a8a810804aceb641c1bd752f35e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7940a345a7c4ccba03eff0476e82d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:17.277073 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-fa5c85c9-d326-4e5b-9736-89d30037e37f tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] 10.222.0.30 "GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd" status: 200 len: 1260 microversion: 2.1 time: 0.152906 Nov 02 14:55:17.277647 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 570/1111] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:55:17 2022] GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:18.301039 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-836da9cb-90eb-4f94-ab18-7f18c37b3529 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:18.301609 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-836da9cb-90eb-4f94-ab18-7f18c37b3529 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] [instance: 96021548-cde6-43f8-a4c2-4da1416b6bfd] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:18.307577 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-836da9cb-90eb-4f94-ab18-7f18c37b3529 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:18.308067 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-836da9cb-90eb-4f94-ab18-7f18c37b3529 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:18.308501 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-836da9cb-90eb-4f94-ab18-7f18c37b3529 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:18.309225 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-836da9cb-90eb-4f94-ab18-7f18c37b3529 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:18.309672 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-836da9cb-90eb-4f94-ab18-7f18c37b3529 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:18.310090 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-836da9cb-90eb-4f94-ab18-7f18c37b3529 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:18.443210 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-836da9cb-90eb-4f94-ab18-7f18c37b3529 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e2a8a810804aceb641c1bd752f35e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7940a345a7c4ccba03eff0476e82d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:18.450737 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-836da9cb-90eb-4f94-ab18-7f18c37b3529 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] 10.222.0.30 "GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd" status: 200 len: 1260 microversion: 2.1 time: 0.154701 Nov 02 14:55:18.451294 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 542/1112] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:55:18 2022] GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:19.474643 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-c67b9060-aa2f-4bbc-b1ff-0d390ce21da9 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:19.475229 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-c67b9060-aa2f-4bbc-b1ff-0d390ce21da9 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] [instance: 96021548-cde6-43f8-a4c2-4da1416b6bfd] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:19.477576 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell0:SELECT=2 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:55:19.482421 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c67b9060-aa2f-4bbc-b1ff-0d390ce21da9 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:19.488340 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c67b9060-aa2f-4bbc-b1ff-0d390ce21da9 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:19.488340 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c67b9060-aa2f-4bbc-b1ff-0d390ce21da9 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:19.488340 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c67b9060-aa2f-4bbc-b1ff-0d390ce21da9 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:19.488340 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c67b9060-aa2f-4bbc-b1ff-0d390ce21da9 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:19.488752 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-c67b9060-aa2f-4bbc-b1ff-0d390ce21da9 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:19.616418 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-c67b9060-aa2f-4bbc-b1ff-0d390ce21da9 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e2a8a810804aceb641c1bd752f35e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7940a345a7c4ccba03eff0476e82d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:19.624344 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-c67b9060-aa2f-4bbc-b1ff-0d390ce21da9 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] 10.222.0.30 "GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd" status: 200 len: 1260 microversion: 2.1 time: 0.153670 Nov 02 14:55:19.624911 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 571/1113] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:55:19 2022] GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:20.646950 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-583f7d1f-1e9f-47ed-86b8-16fd186b9ac2 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:20.647568 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-583f7d1f-1e9f-47ed-86b8-16fd186b9ac2 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] [instance: 96021548-cde6-43f8-a4c2-4da1416b6bfd] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:20.649529 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell0:SELECT=2 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:55:20.651095 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell0:SELECT=8 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:55:20.657521 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-583f7d1f-1e9f-47ed-86b8-16fd186b9ac2 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:20.658166 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-583f7d1f-1e9f-47ed-86b8-16fd186b9ac2 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:20.658793 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-583f7d1f-1e9f-47ed-86b8-16fd186b9ac2 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:20.659674 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-583f7d1f-1e9f-47ed-86b8-16fd186b9ac2 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:20.660544 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-583f7d1f-1e9f-47ed-86b8-16fd186b9ac2 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:20.666086 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-583f7d1f-1e9f-47ed-86b8-16fd186b9ac2 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:20.794651 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-583f7d1f-1e9f-47ed-86b8-16fd186b9ac2 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e2a8a810804aceb641c1bd752f35e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7940a345a7c4ccba03eff0476e82d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:20.803052 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-583f7d1f-1e9f-47ed-86b8-16fd186b9ac2 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] 10.222.0.30 "GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd" status: 200 len: 1260 microversion: 2.1 time: 0.159932 Nov 02 14:55:20.803612 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 543/1114] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:55:20 2022] GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:55:21.826084 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-3de9ccd3-db0c-4c1b-981e-c0840a331699 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:21.833849 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-3de9ccd3-db0c-4c1b-981e-c0840a331699 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] [instance: 96021548-cde6-43f8-a4c2-4da1416b6bfd] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:21.833849 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3de9ccd3-db0c-4c1b-981e-c0840a331699 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:21.834087 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3de9ccd3-db0c-4c1b-981e-c0840a331699 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:21.834476 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3de9ccd3-db0c-4c1b-981e-c0840a331699 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:21.835176 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3de9ccd3-db0c-4c1b-981e-c0840a331699 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:21.835630 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3de9ccd3-db0c-4c1b-981e-c0840a331699 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:21.836058 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-3de9ccd3-db0c-4c1b-981e-c0840a331699 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:21.980401 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-3de9ccd3-db0c-4c1b-981e-c0840a331699 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e2a8a810804aceb641c1bd752f35e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7940a345a7c4ccba03eff0476e82d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:21.988749 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-3de9ccd3-db0c-4c1b-981e-c0840a331699 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] 10.222.0.30 "GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd" status: 200 len: 1260 microversion: 2.1 time: 0.166714 Nov 02 14:55:21.989355 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 572/1115] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:55:21 2022] GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:23.012001 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-2fe5a3fd-4531-49a1-8234-0357f94ff74d tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:23.012609 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-2fe5a3fd-4531-49a1-8234-0357f94ff74d tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] [instance: 96021548-cde6-43f8-a4c2-4da1416b6bfd] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:23.019382 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2fe5a3fd-4531-49a1-8234-0357f94ff74d tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:23.019866 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2fe5a3fd-4531-49a1-8234-0357f94ff74d tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:23.020417 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2fe5a3fd-4531-49a1-8234-0357f94ff74d tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:23.021227 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2fe5a3fd-4531-49a1-8234-0357f94ff74d tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:23.021595 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2fe5a3fd-4531-49a1-8234-0357f94ff74d tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:23.022029 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-2fe5a3fd-4531-49a1-8234-0357f94ff74d tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:23.161103 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-2fe5a3fd-4531-49a1-8234-0357f94ff74d tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e2a8a810804aceb641c1bd752f35e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7940a345a7c4ccba03eff0476e82d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:23.163230 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-2fe5a3fd-4531-49a1-8234-0357f94ff74d tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] 10.222.0.30 "GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd" status: 200 len: 1260 microversion: 2.1 time: 0.155245 Nov 02 14:55:23.163804 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 544/1116] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:55:23 2022] GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:24.186151 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-5a555953-7b06-4c5c-b451-1bbb7a8b2f62 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:24.186708 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-5a555953-7b06-4c5c-b451-1bbb7a8b2f62 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] [instance: 96021548-cde6-43f8-a4c2-4da1416b6bfd] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:24.193865 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5a555953-7b06-4c5c-b451-1bbb7a8b2f62 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:24.194475 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5a555953-7b06-4c5c-b451-1bbb7a8b2f62 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:24.194877 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5a555953-7b06-4c5c-b451-1bbb7a8b2f62 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:24.195571 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5a555953-7b06-4c5c-b451-1bbb7a8b2f62 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:24.196035 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5a555953-7b06-4c5c-b451-1bbb7a8b2f62 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:24.196457 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5a555953-7b06-4c5c-b451-1bbb7a8b2f62 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:24.336549 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-5a555953-7b06-4c5c-b451-1bbb7a8b2f62 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e2a8a810804aceb641c1bd752f35e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7940a345a7c4ccba03eff0476e82d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:24.344246 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-5a555953-7b06-4c5c-b451-1bbb7a8b2f62 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] 10.222.0.30 "GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd" status: 200 len: 1260 microversion: 2.1 time: 0.162073 Nov 02 14:55:24.344803 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 573/1117] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:55:24 2022] GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:25.368385 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-f316cedb-6a26-459c-ab2d-1d6ae9f098a5 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:25.369045 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-f316cedb-6a26-459c-ab2d-1d6ae9f098a5 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] [instance: 96021548-cde6-43f8-a4c2-4da1416b6bfd] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:25.375614 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f316cedb-6a26-459c-ab2d-1d6ae9f098a5 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:25.376095 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f316cedb-6a26-459c-ab2d-1d6ae9f098a5 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:25.376531 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f316cedb-6a26-459c-ab2d-1d6ae9f098a5 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:25.377851 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f316cedb-6a26-459c-ab2d-1d6ae9f098a5 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:25.378311 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f316cedb-6a26-459c-ab2d-1d6ae9f098a5 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:25.378734 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-f316cedb-6a26-459c-ab2d-1d6ae9f098a5 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:25.510074 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-f316cedb-6a26-459c-ab2d-1d6ae9f098a5 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e2a8a810804aceb641c1bd752f35e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7940a345a7c4ccba03eff0476e82d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:25.517745 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-f316cedb-6a26-459c-ab2d-1d6ae9f098a5 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] 10.222.0.30 "GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd" status: 200 len: 1260 microversion: 2.1 time: 0.153188 Nov 02 14:55:25.518300 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 545/1118] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:55:25 2022] GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:26.494862 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [req-107a559b-e332-4b14-98b4-6ee7d36879f5 req-4a8a65f8-37b7-411a-bcc2-e68b834b98f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96021548-cde6-43f8-a4c2-4da1416b6bfd", "name": "network-vif-plugged", "status": "completed", "tag": "f268e93c-fd04-4d6b-809f-68b16158c800"}]} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:55:26.505141 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-107a559b-e332-4b14-98b4-6ee7d36879f5 req-4a8a65f8-37b7-411a-bcc2-e68b834b98f9 service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:26.505616 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-107a559b-e332-4b14-98b4-6ee7d36879f5 req-4a8a65f8-37b7-411a-bcc2-e68b834b98f9 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:26.506046 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-107a559b-e332-4b14-98b4-6ee7d36879f5 req-4a8a65f8-37b7-411a-bcc2-e68b834b98f9 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:26.517219 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.compute.server_external_events [req-107a559b-e332-4b14-98b4-6ee7d36879f5 req-4a8a65f8-37b7-411a-bcc2-e68b834b98f9 service nova] Creating event network-vif-plugged:f268e93c-fd04-4d6b-809f-68b16158c800 for instance 96021548-cde6-43f8-a4c2-4da1416b6bfd on hv-cinder-86236 Nov 02 14:55:26.523284 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [req-107a559b-e332-4b14-98b4-6ee7d36879f5 req-4a8a65f8-37b7-411a-bcc2-e68b834b98f9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086206 Nov 02 14:55:26.523800 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 574/1119] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:55:26.540021 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-917ecbed-aa2d-49b3-8695-c32f8664c0a2 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:26.540640 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-917ecbed-aa2d-49b3-8695-c32f8664c0a2 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] [instance: 96021548-cde6-43f8-a4c2-4da1416b6bfd] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:26.547325 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-917ecbed-aa2d-49b3-8695-c32f8664c0a2 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:26.547815 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-917ecbed-aa2d-49b3-8695-c32f8664c0a2 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:26.548305 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-917ecbed-aa2d-49b3-8695-c32f8664c0a2 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:26.549101 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-917ecbed-aa2d-49b3-8695-c32f8664c0a2 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:26.549551 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-917ecbed-aa2d-49b3-8695-c32f8664c0a2 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:26.549974 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-917ecbed-aa2d-49b3-8695-c32f8664c0a2 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:26.698574 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-917ecbed-aa2d-49b3-8695-c32f8664c0a2 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e2a8a810804aceb641c1bd752f35e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7940a345a7c4ccba03eff0476e82d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:26.707262 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-917ecbed-aa2d-49b3-8695-c32f8664c0a2 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] 10.222.0.30 "GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd" status: 200 len: 1260 microversion: 2.1 time: 0.171321 Nov 02 14:55:26.707828 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 546/1120] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:55:26 2022] GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:27.731501 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-1df0c7be-52fd-4108-b5fa-ebd9a6b485da tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:27.732181 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-1df0c7be-52fd-4108-b5fa-ebd9a6b485da tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] [instance: 96021548-cde6-43f8-a4c2-4da1416b6bfd] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:27.738325 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1df0c7be-52fd-4108-b5fa-ebd9a6b485da tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:27.738802 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1df0c7be-52fd-4108-b5fa-ebd9a6b485da tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:27.739267 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1df0c7be-52fd-4108-b5fa-ebd9a6b485da tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:27.740105 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1df0c7be-52fd-4108-b5fa-ebd9a6b485da tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:27.740550 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1df0c7be-52fd-4108-b5fa-ebd9a6b485da tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:27.740968 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-1df0c7be-52fd-4108-b5fa-ebd9a6b485da tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:27.872081 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-1df0c7be-52fd-4108-b5fa-ebd9a6b485da tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e2a8a810804aceb641c1bd752f35e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7940a345a7c4ccba03eff0476e82d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:27.880386 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-1df0c7be-52fd-4108-b5fa-ebd9a6b485da tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] 10.222.0.30 "GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd" status: 200 len: 1260 microversion: 2.1 time: 0.153219 Nov 02 14:55:27.881653 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 575/1121] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:55:27 2022] GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:28.905875 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-dbf1db8f-ac04-4bd4-92e4-35c641aefbfa tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:28.906553 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-dbf1db8f-ac04-4bd4-92e4-35c641aefbfa tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] [instance: 96021548-cde6-43f8-a4c2-4da1416b6bfd] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:28.913569 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-dbf1db8f-ac04-4bd4-92e4-35c641aefbfa tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:28.917182 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-dbf1db8f-ac04-4bd4-92e4-35c641aefbfa tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:28.917182 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-dbf1db8f-ac04-4bd4-92e4-35c641aefbfa tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:28.917182 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-dbf1db8f-ac04-4bd4-92e4-35c641aefbfa tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:28.917182 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-dbf1db8f-ac04-4bd4-92e4-35c641aefbfa tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:28.917633 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-dbf1db8f-ac04-4bd4-92e4-35c641aefbfa tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:29.051481 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-dbf1db8f-ac04-4bd4-92e4-35c641aefbfa tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e2a8a810804aceb641c1bd752f35e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7940a345a7c4ccba03eff0476e82d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:29.059788 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-dbf1db8f-ac04-4bd4-92e4-35c641aefbfa tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] 10.222.0.30 "GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd" status: 200 len: 1444 microversion: 2.1 time: 0.157962 Nov 02 14:55:29.060353 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 547/1122] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:55:28 2022] GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd => generated 1444 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:29.081775 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-5c804b7f-3792-47e6-9b20-9e890e31c59a tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:29.082386 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-5c804b7f-3792-47e6-9b20-9e890e31c59a tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] [instance: 96021548-cde6-43f8-a4c2-4da1416b6bfd] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:29.089744 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5c804b7f-3792-47e6-9b20-9e890e31c59a tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:29.090220 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5c804b7f-3792-47e6-9b20-9e890e31c59a tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:29.090666 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5c804b7f-3792-47e6-9b20-9e890e31c59a tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:29.091350 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5c804b7f-3792-47e6-9b20-9e890e31c59a tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:29.091991 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5c804b7f-3792-47e6-9b20-9e890e31c59a tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:29.092422 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-5c804b7f-3792-47e6-9b20-9e890e31c59a tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:29.229173 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-5c804b7f-3792-47e6-9b20-9e890e31c59a tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e2a8a810804aceb641c1bd752f35e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7940a345a7c4ccba03eff0476e82d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:29.236838 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-5c804b7f-3792-47e6-9b20-9e890e31c59a tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] 10.222.0.30 "GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd" status: 200 len: 1444 microversion: 2.1 time: 0.158873 Nov 02 14:55:29.238617 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 576/1123] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:55:29 2022] GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd => generated 1444 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:31.254571 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [req-9e8be63c-e633-4790-9444-da2af55df3a7 req-ae5bb8d9-13a1-4759-ba40-0983db293cc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96021548-cde6-43f8-a4c2-4da1416b6bfd", "tag": "f268e93c-fd04-4d6b-809f-68b16158c800"}]} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:55:31.264585 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-9e8be63c-e633-4790-9444-da2af55df3a7 req-ae5bb8d9-13a1-4759-ba40-0983db293cc5 service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:31.264992 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-9e8be63c-e633-4790-9444-da2af55df3a7 req-ae5bb8d9-13a1-4759-ba40-0983db293cc5 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:31.265449 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-9e8be63c-e633-4790-9444-da2af55df3a7 req-ae5bb8d9-13a1-4759-ba40-0983db293cc5 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:31.277352 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.compute.server_external_events [req-9e8be63c-e633-4790-9444-da2af55df3a7 req-ae5bb8d9-13a1-4759-ba40-0983db293cc5 service nova] Creating event network-changed:f268e93c-fd04-4d6b-809f-68b16158c800 for instance 96021548-cde6-43f8-a4c2-4da1416b6bfd on hv-cinder-86236 Nov 02 14:55:31.282436 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [req-9e8be63c-e633-4790-9444-da2af55df3a7 req-ae5bb8d9-13a1-4759-ba40-0983db293cc5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031501 Nov 02 14:55:31.283028 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 548/1124] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:57:25.316770 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR oslo.messaging._drivers.impl_rabbit [-] [db404912-8851-472d-9043-bf1c0d153277] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 02 14:57:25.317513 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_api:SELECT=24 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:57:25.318250 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell1:SELECT=56 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:57:25.319380 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Nov 02 14:57:25.324009 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-195489aa-21bc-4a9b-8848-8cdc0c296054 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:57:25.324534 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-195489aa-21bc-4a9b-8848-8cdc0c296054 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] [instance: 96021548-cde6-43f8-a4c2-4da1416b6bfd] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:25.331035 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-195489aa-21bc-4a9b-8848-8cdc0c296054 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:25.336959 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-195489aa-21bc-4a9b-8848-8cdc0c296054 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:25.336959 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-195489aa-21bc-4a9b-8848-8cdc0c296054 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:25.336959 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-195489aa-21bc-4a9b-8848-8cdc0c296054 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:25.336959 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-195489aa-21bc-4a9b-8848-8cdc0c296054 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:25.337409 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-195489aa-21bc-4a9b-8848-8cdc0c296054 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:25.355978 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.objects.instance [None req-195489aa-21bc-4a9b-8848-8cdc0c296054 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lazy-loading 'flavor' on Instance uuid 96021548-cde6-43f8-a4c2-4da1416b6bfd {{(pid=119659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:57:25.540931 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-195489aa-21bc-4a9b-8848-8cdc0c296054 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] 10.222.0.30 "POST /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd/action" status: 202 len: 0 microversion: 2.1 time: 0.225873 Nov 02 14:57:25.541578 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 577/1125] 10.222.0.30 () {60 vars in 1278 bytes} [Wed Nov 2 14:57:25 2022] POST /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 14:57:25.549135 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:57:25.549889 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell1:SELECT=54 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:57:25.551521 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 14:57:25.551684 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Wed Nov 2 14:57:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd (ip 10.222.0.30) !!! Nov 02 14:57:25.557468 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-5443f09a-8aaf-4785-aab4-ed5f15bacfb8 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:25.558172 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-5443f09a-8aaf-4785-aab4-ed5f15bacfb8 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] [instance: 96021548-cde6-43f8-a4c2-4da1416b6bfd] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:25.566864 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5443f09a-8aaf-4785-aab4-ed5f15bacfb8 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:25.567278 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5443f09a-8aaf-4785-aab4-ed5f15bacfb8 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:25.567744 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5443f09a-8aaf-4785-aab4-ed5f15bacfb8 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:25.568442 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5443f09a-8aaf-4785-aab4-ed5f15bacfb8 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:25.568954 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5443f09a-8aaf-4785-aab4-ed5f15bacfb8 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:25.569414 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5443f09a-8aaf-4785-aab4-ed5f15bacfb8 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:25.705098 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-5443f09a-8aaf-4785-aab4-ed5f15bacfb8 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e2a8a810804aceb641c1bd752f35e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7940a345a7c4ccba03eff0476e82d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:57:25.712955 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-5443f09a-8aaf-4785-aab4-ed5f15bacfb8 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] 10.222.0.30 "GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd" status: 200 len: 1568 microversion: 2.1 time: 0.165951 Nov 02 14:57:25.713557 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 549/1126] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:57:25 2022] GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:57:26.740237 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-52abfe56-fc95-40ec-921f-03fed836b205 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:26.740936 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-52abfe56-fc95-40ec-921f-03fed836b205 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] [instance: 96021548-cde6-43f8-a4c2-4da1416b6bfd] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:26.748473 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-52abfe56-fc95-40ec-921f-03fed836b205 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:26.748963 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-52abfe56-fc95-40ec-921f-03fed836b205 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:26.749406 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-52abfe56-fc95-40ec-921f-03fed836b205 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:26.750093 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-52abfe56-fc95-40ec-921f-03fed836b205 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:26.750542 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-52abfe56-fc95-40ec-921f-03fed836b205 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:26.750966 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-52abfe56-fc95-40ec-921f-03fed836b205 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:26.754396 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO oslo.messaging._drivers.impl_rabbit [-] [db404912-8851-472d-9043-bf1c0d153277] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 40096. Nov 02 14:57:26.884392 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-52abfe56-fc95-40ec-921f-03fed836b205 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e2a8a810804aceb641c1bd752f35e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7940a345a7c4ccba03eff0476e82d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:57:26.892812 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-52abfe56-fc95-40ec-921f-03fed836b205 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] 10.222.0.30 "GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd" status: 200 len: 1568 microversion: 2.1 time: 0.158347 Nov 02 14:57:26.893419 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 578/1127] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:57:26 2022] GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:57:27.915773 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-571f1e1a-c265-4ceb-9ade-6a14f4b7c954 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:27.916412 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-571f1e1a-c265-4ceb-9ade-6a14f4b7c954 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] [instance: 96021548-cde6-43f8-a4c2-4da1416b6bfd] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:27.923591 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-571f1e1a-c265-4ceb-9ade-6a14f4b7c954 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:27.924068 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-571f1e1a-c265-4ceb-9ade-6a14f4b7c954 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:27.924498 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-571f1e1a-c265-4ceb-9ade-6a14f4b7c954 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:27.925210 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-571f1e1a-c265-4ceb-9ade-6a14f4b7c954 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:27.925660 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-571f1e1a-c265-4ceb-9ade-6a14f4b7c954 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:27.926081 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-571f1e1a-c265-4ceb-9ade-6a14f4b7c954 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:28.054399 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-571f1e1a-c265-4ceb-9ade-6a14f4b7c954 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e2a8a810804aceb641c1bd752f35e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7940a345a7c4ccba03eff0476e82d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:57:28.062543 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-571f1e1a-c265-4ceb-9ade-6a14f4b7c954 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] 10.222.0.30 "GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd" status: 200 len: 1568 microversion: 2.1 time: 0.150704 Nov 02 14:57:28.063094 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 550/1128] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:57:27 2022] GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:57:29.085907 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-ba1d19b6-44d7-425d-a0d0-cfd1fcdd0cb2 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:29.086512 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-ba1d19b6-44d7-425d-a0d0-cfd1fcdd0cb2 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] [instance: 96021548-cde6-43f8-a4c2-4da1416b6bfd] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:29.093595 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ba1d19b6-44d7-425d-a0d0-cfd1fcdd0cb2 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:29.094070 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ba1d19b6-44d7-425d-a0d0-cfd1fcdd0cb2 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:29.094503 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ba1d19b6-44d7-425d-a0d0-cfd1fcdd0cb2 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:29.095182 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ba1d19b6-44d7-425d-a0d0-cfd1fcdd0cb2 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:29.095623 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ba1d19b6-44d7-425d-a0d0-cfd1fcdd0cb2 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:29.096041 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ba1d19b6-44d7-425d-a0d0-cfd1fcdd0cb2 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:29.227026 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-ba1d19b6-44d7-425d-a0d0-cfd1fcdd0cb2 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e2a8a810804aceb641c1bd752f35e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7940a345a7c4ccba03eff0476e82d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:57:29.234879 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-ba1d19b6-44d7-425d-a0d0-cfd1fcdd0cb2 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] 10.222.0.30 "GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd" status: 200 len: 1568 microversion: 2.1 time: 0.152859 Nov 02 14:57:29.235453 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 579/1129] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:57:29 2022] GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:57:30.258659 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-0c60d173-e83c-4193-99a6-f05121122cbd tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:30.259298 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-0c60d173-e83c-4193-99a6-f05121122cbd tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] [instance: 96021548-cde6-43f8-a4c2-4da1416b6bfd] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:30.265444 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0c60d173-e83c-4193-99a6-f05121122cbd tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:30.265973 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0c60d173-e83c-4193-99a6-f05121122cbd tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:30.266410 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0c60d173-e83c-4193-99a6-f05121122cbd tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:30.267114 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0c60d173-e83c-4193-99a6-f05121122cbd tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:30.267566 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0c60d173-e83c-4193-99a6-f05121122cbd tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:30.267991 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-0c60d173-e83c-4193-99a6-f05121122cbd tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:30.398706 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-0c60d173-e83c-4193-99a6-f05121122cbd tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e2a8a810804aceb641c1bd752f35e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7940a345a7c4ccba03eff0476e82d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:57:30.406887 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-0c60d173-e83c-4193-99a6-f05121122cbd tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] 10.222.0.30 "GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd" status: 200 len: 1568 microversion: 2.1 time: 0.152121 Nov 02 14:57:30.407446 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 551/1130] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:57:30 2022] GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:57:31.431482 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-302e415e-ea68-4c5f-88ef-dd06c98a531b tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:31.432086 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-302e415e-ea68-4c5f-88ef-dd06c98a531b tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] [instance: 96021548-cde6-43f8-a4c2-4da1416b6bfd] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:31.438687 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-302e415e-ea68-4c5f-88ef-dd06c98a531b tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:31.439163 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-302e415e-ea68-4c5f-88ef-dd06c98a531b tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:31.439597 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-302e415e-ea68-4c5f-88ef-dd06c98a531b tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:31.440322 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-302e415e-ea68-4c5f-88ef-dd06c98a531b tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:31.440763 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-302e415e-ea68-4c5f-88ef-dd06c98a531b tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:31.441226 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-302e415e-ea68-4c5f-88ef-dd06c98a531b tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:31.569988 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-302e415e-ea68-4c5f-88ef-dd06c98a531b tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e2a8a810804aceb641c1bd752f35e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7940a345a7c4ccba03eff0476e82d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:57:31.578446 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-302e415e-ea68-4c5f-88ef-dd06c98a531b tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] 10.222.0.30 "GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd" status: 200 len: 1568 microversion: 2.1 time: 0.150850 Nov 02 14:57:31.579013 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 580/1131] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:57:31 2022] GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:57:32.601805 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-09f0fba2-0659-493f-911e-90f868b2c656 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:32.603031 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-09f0fba2-0659-493f-911e-90f868b2c656 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] [instance: 96021548-cde6-43f8-a4c2-4da1416b6bfd] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:32.610025 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-09f0fba2-0659-493f-911e-90f868b2c656 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:32.610513 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-09f0fba2-0659-493f-911e-90f868b2c656 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:32.610941 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-09f0fba2-0659-493f-911e-90f868b2c656 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:32.611627 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-09f0fba2-0659-493f-911e-90f868b2c656 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:32.612075 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-09f0fba2-0659-493f-911e-90f868b2c656 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:32.612500 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-09f0fba2-0659-493f-911e-90f868b2c656 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:32.745466 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-09f0fba2-0659-493f-911e-90f868b2c656 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e2a8a810804aceb641c1bd752f35e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7940a345a7c4ccba03eff0476e82d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:57:32.753643 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-09f0fba2-0659-493f-911e-90f868b2c656 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] 10.222.0.30 "GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd" status: 200 len: 1568 microversion: 2.1 time: 0.155671 Nov 02 14:57:32.754212 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 552/1132] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:57:32 2022] GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:57:33.777070 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-65f6c3d4-9cb0-4867-b8dd-5973648d885a tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:33.777702 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-65f6c3d4-9cb0-4867-b8dd-5973648d885a tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] [instance: 96021548-cde6-43f8-a4c2-4da1416b6bfd] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:33.784169 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-65f6c3d4-9cb0-4867-b8dd-5973648d885a tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:33.784642 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-65f6c3d4-9cb0-4867-b8dd-5973648d885a tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:33.785100 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-65f6c3d4-9cb0-4867-b8dd-5973648d885a tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:33.785785 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-65f6c3d4-9cb0-4867-b8dd-5973648d885a tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:33.786234 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-65f6c3d4-9cb0-4867-b8dd-5973648d885a tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:33.786652 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-65f6c3d4-9cb0-4867-b8dd-5973648d885a tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:33.916672 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-65f6c3d4-9cb0-4867-b8dd-5973648d885a tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e2a8a810804aceb641c1bd752f35e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7940a345a7c4ccba03eff0476e82d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:57:33.925038 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-65f6c3d4-9cb0-4867-b8dd-5973648d885a tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] 10.222.0.30 "GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd" status: 200 len: 1568 microversion: 2.1 time: 0.151870 Nov 02 14:57:33.925604 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 581/1133] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:57:33 2022] GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:57:34.947733 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-8107d7fe-c2b4-4262-946e-ae7145680c3c tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:34.948373 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-8107d7fe-c2b4-4262-946e-ae7145680c3c tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] [instance: 96021548-cde6-43f8-a4c2-4da1416b6bfd] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:34.955543 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8107d7fe-c2b4-4262-946e-ae7145680c3c tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:34.956037 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8107d7fe-c2b4-4262-946e-ae7145680c3c tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:34.956475 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8107d7fe-c2b4-4262-946e-ae7145680c3c tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:34.957206 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8107d7fe-c2b4-4262-946e-ae7145680c3c tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:34.957659 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8107d7fe-c2b4-4262-946e-ae7145680c3c tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:34.958090 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8107d7fe-c2b4-4262-946e-ae7145680c3c tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:35.090035 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-8107d7fe-c2b4-4262-946e-ae7145680c3c tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e2a8a810804aceb641c1bd752f35e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7940a345a7c4ccba03eff0476e82d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:57:35.097886 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-8107d7fe-c2b4-4262-946e-ae7145680c3c tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] 10.222.0.30 "GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd" status: 200 len: 1568 microversion: 2.1 time: 0.154065 Nov 02 14:57:35.098444 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 553/1134] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:57:34 2022] GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:57:36.121085 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-41744b72-3101-48a4-b855-36facef16e87 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:36.121726 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-41744b72-3101-48a4-b855-36facef16e87 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] [instance: 96021548-cde6-43f8-a4c2-4da1416b6bfd] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:36.129215 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-41744b72-3101-48a4-b855-36facef16e87 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:36.129705 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-41744b72-3101-48a4-b855-36facef16e87 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:36.130140 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-41744b72-3101-48a4-b855-36facef16e87 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:36.130838 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-41744b72-3101-48a4-b855-36facef16e87 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:36.131296 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-41744b72-3101-48a4-b855-36facef16e87 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:36.131721 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-41744b72-3101-48a4-b855-36facef16e87 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:36.263906 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-41744b72-3101-48a4-b855-36facef16e87 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e2a8a810804aceb641c1bd752f35e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7940a345a7c4ccba03eff0476e82d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:57:36.271571 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-41744b72-3101-48a4-b855-36facef16e87 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] 10.222.0.30 "GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd" status: 200 len: 1568 microversion: 2.1 time: 0.154363 Nov 02 14:57:36.272147 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 582/1135] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:57:36 2022] GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:57:37.295814 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-21916896-5369-4318-a141-2ea2ab1a48ad tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:37.296355 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-21916896-5369-4318-a141-2ea2ab1a48ad tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] [instance: 96021548-cde6-43f8-a4c2-4da1416b6bfd] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:37.302950 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-21916896-5369-4318-a141-2ea2ab1a48ad tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:37.303432 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-21916896-5369-4318-a141-2ea2ab1a48ad tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:37.303872 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-21916896-5369-4318-a141-2ea2ab1a48ad tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:37.304557 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-21916896-5369-4318-a141-2ea2ab1a48ad tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:37.305024 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-21916896-5369-4318-a141-2ea2ab1a48ad tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:37.305451 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-21916896-5369-4318-a141-2ea2ab1a48ad tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:37.434822 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-21916896-5369-4318-a141-2ea2ab1a48ad tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e2a8a810804aceb641c1bd752f35e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7940a345a7c4ccba03eff0476e82d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:57:37.443667 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-21916896-5369-4318-a141-2ea2ab1a48ad tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] 10.222.0.30 "GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd" status: 200 len: 1568 microversion: 2.1 time: 0.152282 Nov 02 14:57:37.444248 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 554/1136] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:57:37 2022] GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:57:38.466905 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-44c96d7d-499f-4b4e-9d29-6613e49a8dfc tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:38.467591 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-44c96d7d-499f-4b4e-9d29-6613e49a8dfc tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] [instance: 96021548-cde6-43f8-a4c2-4da1416b6bfd] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:38.473956 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-44c96d7d-499f-4b4e-9d29-6613e49a8dfc tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:38.476861 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-44c96d7d-499f-4b4e-9d29-6613e49a8dfc tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:38.476861 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-44c96d7d-499f-4b4e-9d29-6613e49a8dfc tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:38.476861 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-44c96d7d-499f-4b4e-9d29-6613e49a8dfc tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:38.476861 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-44c96d7d-499f-4b4e-9d29-6613e49a8dfc tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:38.477449 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-44c96d7d-499f-4b4e-9d29-6613e49a8dfc tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:38.611926 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-44c96d7d-499f-4b4e-9d29-6613e49a8dfc tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e2a8a810804aceb641c1bd752f35e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7940a345a7c4ccba03eff0476e82d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:57:38.620079 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-44c96d7d-499f-4b4e-9d29-6613e49a8dfc tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] 10.222.0.30 "GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd" status: 200 len: 1568 microversion: 2.1 time: 0.157618 Nov 02 14:57:38.620653 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 583/1137] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:57:38 2022] GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:57:39.644349 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-aaba8b2e-d07a-4cb3-983b-8dc96070548e tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:39.644958 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-aaba8b2e-d07a-4cb3-983b-8dc96070548e tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] [instance: 96021548-cde6-43f8-a4c2-4da1416b6bfd] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:39.651337 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-aaba8b2e-d07a-4cb3-983b-8dc96070548e tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:39.651834 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-aaba8b2e-d07a-4cb3-983b-8dc96070548e tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:39.652251 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-aaba8b2e-d07a-4cb3-983b-8dc96070548e tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:39.652936 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-aaba8b2e-d07a-4cb3-983b-8dc96070548e tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:39.653408 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-aaba8b2e-d07a-4cb3-983b-8dc96070548e tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:39.653831 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-aaba8b2e-d07a-4cb3-983b-8dc96070548e tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:39.781521 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-aaba8b2e-d07a-4cb3-983b-8dc96070548e tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e2a8a810804aceb641c1bd752f35e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7940a345a7c4ccba03eff0476e82d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:57:39.789292 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-aaba8b2e-d07a-4cb3-983b-8dc96070548e tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] 10.222.0.30 "GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd" status: 200 len: 1509 microversion: 2.1 time: 0.148800 Nov 02 14:57:39.789859 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 555/1138] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:57:39 2022] GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd => generated 1509 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:57:39.811420 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-4ee38fab-dbae-4726-bb60-c082e9172e44 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:57:39.812012 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-4ee38fab-dbae-4726-bb60-c082e9172e44 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] [instance: 96021548-cde6-43f8-a4c2-4da1416b6bfd] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:39.818338 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4ee38fab-dbae-4726-bb60-c082e9172e44 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:39.818815 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4ee38fab-dbae-4726-bb60-c082e9172e44 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:39.819244 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4ee38fab-dbae-4726-bb60-c082e9172e44 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:39.819923 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4ee38fab-dbae-4726-bb60-c082e9172e44 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:39.820371 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4ee38fab-dbae-4726-bb60-c082e9172e44 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:39.820790 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4ee38fab-dbae-4726-bb60-c082e9172e44 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:39.959913 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-4ee38fab-dbae-4726-bb60-c082e9172e44 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] [instance: 96021548-cde6-43f8-a4c2-4da1416b6bfd] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119659) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Nov 02 14:57:40.230970 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-4ee38fab-dbae-4726-bb60-c082e9172e44 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] 10.222.0.30 "POST /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd/action" status: 202 len: 0 microversion: 2.1 time: 0.423267 Nov 02 14:57:40.231506 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 584/1139] 10.222.0.30 () {60 vars in 1278 bytes} [Wed Nov 2 14:57:39 2022] POST /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd/action => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:57:40.239655 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-5c81c979-e1d3-45fa-bf33-bbab62cfee4c tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:40.240266 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-5c81c979-e1d3-45fa-bf33-bbab62cfee4c tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] [instance: 96021548-cde6-43f8-a4c2-4da1416b6bfd] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:40.246178 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5c81c979-e1d3-45fa-bf33-bbab62cfee4c tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:40.246666 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5c81c979-e1d3-45fa-bf33-bbab62cfee4c tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:40.251689 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5c81c979-e1d3-45fa-bf33-bbab62cfee4c tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:40.251689 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5c81c979-e1d3-45fa-bf33-bbab62cfee4c tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:40.251689 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5c81c979-e1d3-45fa-bf33-bbab62cfee4c tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:40.251689 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5c81c979-e1d3-45fa-bf33-bbab62cfee4c tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:40.392835 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-5c81c979-e1d3-45fa-bf33-bbab62cfee4c tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e2a8a810804aceb641c1bd752f35e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7940a345a7c4ccba03eff0476e82d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:57:40.402389 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-5c81c979-e1d3-45fa-bf33-bbab62cfee4c tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] 10.222.0.30 "GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd" status: 200 len: 1517 microversion: 2.1 time: 0.166452 Nov 02 14:57:40.402851 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 556/1140] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:57:40 2022] GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd => generated 1517 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:57:41.425870 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-2c3a0b68-238d-4150-81fd-25e1c4f88e62 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:41.426513 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-2c3a0b68-238d-4150-81fd-25e1c4f88e62 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] [instance: 96021548-cde6-43f8-a4c2-4da1416b6bfd] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:41.432369 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2c3a0b68-238d-4150-81fd-25e1c4f88e62 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:41.432844 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2c3a0b68-238d-4150-81fd-25e1c4f88e62 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:41.433326 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2c3a0b68-238d-4150-81fd-25e1c4f88e62 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:41.434014 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2c3a0b68-238d-4150-81fd-25e1c4f88e62 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:41.434465 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2c3a0b68-238d-4150-81fd-25e1c4f88e62 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:41.434887 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2c3a0b68-238d-4150-81fd-25e1c4f88e62 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:41.567268 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-2c3a0b68-238d-4150-81fd-25e1c4f88e62 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e2a8a810804aceb641c1bd752f35e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7940a345a7c4ccba03eff0476e82d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:57:41.575226 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-2c3a0b68-238d-4150-81fd-25e1c4f88e62 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] 10.222.0.30 "GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd" status: 200 len: 1517 microversion: 2.1 time: 0.153942 Nov 02 14:57:41.575852 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 585/1141] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:57:41 2022] GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:57:42.599537 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-8622bb0e-e867-4717-94b7-e02c452970c5 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:42.600455 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-8622bb0e-e867-4717-94b7-e02c452970c5 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] [instance: 96021548-cde6-43f8-a4c2-4da1416b6bfd] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:42.607392 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8622bb0e-e867-4717-94b7-e02c452970c5 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:42.607977 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8622bb0e-e867-4717-94b7-e02c452970c5 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:42.609056 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8622bb0e-e867-4717-94b7-e02c452970c5 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:42.609860 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8622bb0e-e867-4717-94b7-e02c452970c5 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:42.610412 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8622bb0e-e867-4717-94b7-e02c452970c5 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:42.610939 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8622bb0e-e867-4717-94b7-e02c452970c5 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:42.746737 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-8622bb0e-e867-4717-94b7-e02c452970c5 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e2a8a810804aceb641c1bd752f35e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7940a345a7c4ccba03eff0476e82d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:57:42.755591 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-8622bb0e-e867-4717-94b7-e02c452970c5 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] 10.222.0.30 "GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd" status: 200 len: 1519 microversion: 2.1 time: 0.160190 Nov 02 14:57:42.756132 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 557/1142] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:57:42 2022] GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:57:42.998863 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [req-b463cab1-ad36-48c5-b5a6-b75ca8a40a55 req-082b1946-3523-487e-a2be-67129ac50b4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96021548-cde6-43f8-a4c2-4da1416b6bfd", "name": "network-vif-unplugged", "status": "completed", "tag": "f268e93c-fd04-4d6b-809f-68b16158c800"}]} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:57:43.009802 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-b463cab1-ad36-48c5-b5a6-b75ca8a40a55 req-082b1946-3523-487e-a2be-67129ac50b4c service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:43.010269 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-b463cab1-ad36-48c5-b5a6-b75ca8a40a55 req-082b1946-3523-487e-a2be-67129ac50b4c service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:43.010693 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-b463cab1-ad36-48c5-b5a6-b75ca8a40a55 req-082b1946-3523-487e-a2be-67129ac50b4c service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:43.021878 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.compute.server_external_events [req-b463cab1-ad36-48c5-b5a6-b75ca8a40a55 req-082b1946-3523-487e-a2be-67129ac50b4c service nova] Unable to find a host for instance 96021548-cde6-43f8-a4c2-4da1416b6bfd. Dropping event network-vif-unplugged {{(pid=119659) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Nov 02 14:57:43.027536 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [req-b463cab1-ad36-48c5-b5a6-b75ca8a40a55 req-082b1946-3523-487e-a2be-67129ac50b4c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028554 Nov 02 14:57:43.027536 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 586/1143] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Nov 02 14:57:43.781080 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-c2192321-bb63-4046-860e-4c9d19b3ae9d tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:43.781695 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-c2192321-bb63-4046-860e-4c9d19b3ae9d tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] [instance: 96021548-cde6-43f8-a4c2-4da1416b6bfd] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:43.788137 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c2192321-bb63-4046-860e-4c9d19b3ae9d tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:43.788617 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c2192321-bb63-4046-860e-4c9d19b3ae9d tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:43.789081 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c2192321-bb63-4046-860e-4c9d19b3ae9d tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:43.789772 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c2192321-bb63-4046-860e-4c9d19b3ae9d tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:43.790219 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c2192321-bb63-4046-860e-4c9d19b3ae9d tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:43.790646 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-c2192321-bb63-4046-860e-4c9d19b3ae9d tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:43.923262 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-c2192321-bb63-4046-860e-4c9d19b3ae9d tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e2a8a810804aceb641c1bd752f35e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7940a345a7c4ccba03eff0476e82d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:57:43.931105 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-c2192321-bb63-4046-860e-4c9d19b3ae9d tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] 10.222.0.30 "GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd" status: 200 len: 1575 microversion: 2.1 time: 0.155585 Nov 02 14:57:43.931675 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 558/1144] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:57:43 2022] GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:57:44.954570 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-7f776214-5b37-4e31-bef3-0fb9aac61788 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:44.955173 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-7f776214-5b37-4e31-bef3-0fb9aac61788 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] [instance: 96021548-cde6-43f8-a4c2-4da1416b6bfd] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:44.961359 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7f776214-5b37-4e31-bef3-0fb9aac61788 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:44.961843 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7f776214-5b37-4e31-bef3-0fb9aac61788 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:44.962277 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7f776214-5b37-4e31-bef3-0fb9aac61788 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:44.962964 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7f776214-5b37-4e31-bef3-0fb9aac61788 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:44.963408 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7f776214-5b37-4e31-bef3-0fb9aac61788 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:44.963828 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-7f776214-5b37-4e31-bef3-0fb9aac61788 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:45.098771 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-7f776214-5b37-4e31-bef3-0fb9aac61788 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e2a8a810804aceb641c1bd752f35e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7940a345a7c4ccba03eff0476e82d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:57:45.106921 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-7f776214-5b37-4e31-bef3-0fb9aac61788 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] 10.222.0.30 "GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd" status: 200 len: 1575 microversion: 2.1 time: 0.156869 Nov 02 14:57:45.107492 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 587/1145] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:57:44 2022] GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:57:46.130764 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-5ac3817a-1a56-4ef9-a8fa-23c2c823ffad tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:46.131389 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-5ac3817a-1a56-4ef9-a8fa-23c2c823ffad tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] [instance: 96021548-cde6-43f8-a4c2-4da1416b6bfd] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:46.137893 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5ac3817a-1a56-4ef9-a8fa-23c2c823ffad tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:46.138380 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5ac3817a-1a56-4ef9-a8fa-23c2c823ffad tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:46.138823 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5ac3817a-1a56-4ef9-a8fa-23c2c823ffad tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:46.139519 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5ac3817a-1a56-4ef9-a8fa-23c2c823ffad tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:46.140002 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5ac3817a-1a56-4ef9-a8fa-23c2c823ffad tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:46.140628 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-5ac3817a-1a56-4ef9-a8fa-23c2c823ffad tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:46.269479 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-5ac3817a-1a56-4ef9-a8fa-23c2c823ffad tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e2a8a810804aceb641c1bd752f35e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7940a345a7c4ccba03eff0476e82d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:57:46.277237 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-5ac3817a-1a56-4ef9-a8fa-23c2c823ffad tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] 10.222.0.30 "GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd" status: 200 len: 1575 microversion: 2.1 time: 0.150373 Nov 02 14:57:46.277814 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 559/1146] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:57:46 2022] GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:57:47.301546 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-ec78ac59-888e-4961-a795-cb804c73a9aa tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:47.302098 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-ec78ac59-888e-4961-a795-cb804c73a9aa tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] [instance: 96021548-cde6-43f8-a4c2-4da1416b6bfd] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:47.308472 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ec78ac59-888e-4961-a795-cb804c73a9aa tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:47.308947 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ec78ac59-888e-4961-a795-cb804c73a9aa tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:47.309406 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ec78ac59-888e-4961-a795-cb804c73a9aa tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:47.310088 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ec78ac59-888e-4961-a795-cb804c73a9aa tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:47.310531 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ec78ac59-888e-4961-a795-cb804c73a9aa tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:47.310968 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-ec78ac59-888e-4961-a795-cb804c73a9aa tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:47.438887 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-ec78ac59-888e-4961-a795-cb804c73a9aa tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e2a8a810804aceb641c1bd752f35e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7940a345a7c4ccba03eff0476e82d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:57:47.446598 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-ec78ac59-888e-4961-a795-cb804c73a9aa tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] 10.222.0.30 "GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd" status: 200 len: 1575 microversion: 2.1 time: 0.148975 Nov 02 14:57:47.447175 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 588/1147] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:57:47 2022] GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:57:48.470220 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-8ec2a426-da66-48f6-849a-b5c9b9fbfb0b tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:48.470898 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-8ec2a426-da66-48f6-849a-b5c9b9fbfb0b tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] [instance: 96021548-cde6-43f8-a4c2-4da1416b6bfd] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:48.477274 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8ec2a426-da66-48f6-849a-b5c9b9fbfb0b tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:48.477753 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8ec2a426-da66-48f6-849a-b5c9b9fbfb0b tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:48.478184 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8ec2a426-da66-48f6-849a-b5c9b9fbfb0b tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:48.478867 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8ec2a426-da66-48f6-849a-b5c9b9fbfb0b tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:48.479316 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8ec2a426-da66-48f6-849a-b5c9b9fbfb0b tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:48.479738 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-8ec2a426-da66-48f6-849a-b5c9b9fbfb0b tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:48.615362 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-8ec2a426-da66-48f6-849a-b5c9b9fbfb0b tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e2a8a810804aceb641c1bd752f35e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7940a345a7c4ccba03eff0476e82d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:57:48.623384 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-8ec2a426-da66-48f6-849a-b5c9b9fbfb0b tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] 10.222.0.30 "GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd" status: 200 len: 1575 microversion: 2.1 time: 0.157531 Nov 02 14:57:48.624489 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 560/1148] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:57:48 2022] GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:57:49.645975 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-2c400573-e546-41ce-869d-88049e268f98 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:49.646606 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-2c400573-e546-41ce-869d-88049e268f98 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] [instance: 96021548-cde6-43f8-a4c2-4da1416b6bfd] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:49.653098 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2c400573-e546-41ce-869d-88049e268f98 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:49.653583 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2c400573-e546-41ce-869d-88049e268f98 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:49.654022 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2c400573-e546-41ce-869d-88049e268f98 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:49.654714 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2c400573-e546-41ce-869d-88049e268f98 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:49.655718 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2c400573-e546-41ce-869d-88049e268f98 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:49.656119 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-2c400573-e546-41ce-869d-88049e268f98 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:49.785576 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-2c400573-e546-41ce-869d-88049e268f98 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e2a8a810804aceb641c1bd752f35e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7940a345a7c4ccba03eff0476e82d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:57:49.793339 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-2c400573-e546-41ce-869d-88049e268f98 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] 10.222.0.30 "GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd" status: 200 len: 1575 microversion: 2.1 time: 0.151150 Nov 02 14:57:49.793933 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 589/1149] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:57:49 2022] GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:57:50.818403 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-ead815ab-620e-4177-b1c3-a45d1e61f76a tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:50.818962 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-ead815ab-620e-4177-b1c3-a45d1e61f76a tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] [instance: 96021548-cde6-43f8-a4c2-4da1416b6bfd] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:50.825466 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ead815ab-620e-4177-b1c3-a45d1e61f76a tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:50.825982 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ead815ab-620e-4177-b1c3-a45d1e61f76a tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:50.826389 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ead815ab-620e-4177-b1c3-a45d1e61f76a tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:50.827627 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ead815ab-620e-4177-b1c3-a45d1e61f76a tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:50.828074 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ead815ab-620e-4177-b1c3-a45d1e61f76a tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:50.828598 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-ead815ab-620e-4177-b1c3-a45d1e61f76a tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:50.967374 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-ead815ab-620e-4177-b1c3-a45d1e61f76a tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e2a8a810804aceb641c1bd752f35e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7940a345a7c4ccba03eff0476e82d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:57:50.976453 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-ead815ab-620e-4177-b1c3-a45d1e61f76a tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] 10.222.0.30 "GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd" status: 200 len: 1575 microversion: 2.1 time: 0.162156 Nov 02 14:57:50.977050 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 561/1150] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:57:50 2022] GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:57:52.002573 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-dd836b8e-a4b3-448b-b99c-12087181ad50 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:52.003173 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-dd836b8e-a4b3-448b-b99c-12087181ad50 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] [instance: 96021548-cde6-43f8-a4c2-4da1416b6bfd] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:52.009630 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-dd836b8e-a4b3-448b-b99c-12087181ad50 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:52.010110 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-dd836b8e-a4b3-448b-b99c-12087181ad50 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:52.010546 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-dd836b8e-a4b3-448b-b99c-12087181ad50 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:52.011237 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-dd836b8e-a4b3-448b-b99c-12087181ad50 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:52.011685 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-dd836b8e-a4b3-448b-b99c-12087181ad50 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:52.012107 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-dd836b8e-a4b3-448b-b99c-12087181ad50 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:52.139370 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-dd836b8e-a4b3-448b-b99c-12087181ad50 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e2a8a810804aceb641c1bd752f35e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7940a345a7c4ccba03eff0476e82d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:57:52.147105 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-dd836b8e-a4b3-448b-b99c-12087181ad50 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] 10.222.0.30 "GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd" status: 200 len: 1575 microversion: 2.1 time: 0.148434 Nov 02 14:57:52.147667 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 590/1151] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:57:51 2022] GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:57:53.171173 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-3b4b2b83-1452-43a6-9f53-50427f9434f4 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:53.171766 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-3b4b2b83-1452-43a6-9f53-50427f9434f4 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] [instance: 96021548-cde6-43f8-a4c2-4da1416b6bfd] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:53.178100 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3b4b2b83-1452-43a6-9f53-50427f9434f4 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:53.178583 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3b4b2b83-1452-43a6-9f53-50427f9434f4 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:53.179019 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3b4b2b83-1452-43a6-9f53-50427f9434f4 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:53.179707 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3b4b2b83-1452-43a6-9f53-50427f9434f4 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:53.180157 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3b4b2b83-1452-43a6-9f53-50427f9434f4 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:53.180587 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-3b4b2b83-1452-43a6-9f53-50427f9434f4 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:53.318257 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-3b4b2b83-1452-43a6-9f53-50427f9434f4 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e2a8a810804aceb641c1bd752f35e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7940a345a7c4ccba03eff0476e82d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:57:53.326160 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-3b4b2b83-1452-43a6-9f53-50427f9434f4 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] 10.222.0.30 "GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd" status: 200 len: 1575 microversion: 2.1 time: 0.159024 Nov 02 14:57:53.326718 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 562/1152] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:57:53 2022] GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:57:54.355743 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-4ac2f9c2-5974-4c28-93f5-4d02b20ed142 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:54.356388 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-4ac2f9c2-5974-4c28-93f5-4d02b20ed142 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] [instance: 96021548-cde6-43f8-a4c2-4da1416b6bfd] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:54.362823 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4ac2f9c2-5974-4c28-93f5-4d02b20ed142 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:54.363306 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4ac2f9c2-5974-4c28-93f5-4d02b20ed142 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:54.363748 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4ac2f9c2-5974-4c28-93f5-4d02b20ed142 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:54.364443 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4ac2f9c2-5974-4c28-93f5-4d02b20ed142 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:54.364898 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4ac2f9c2-5974-4c28-93f5-4d02b20ed142 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:54.365353 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4ac2f9c2-5974-4c28-93f5-4d02b20ed142 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:54.369345 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:57:54.495349 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-4ac2f9c2-5974-4c28-93f5-4d02b20ed142 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e2a8a810804aceb641c1bd752f35e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7940a345a7c4ccba03eff0476e82d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:57:54.503881 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-4ac2f9c2-5974-4c28-93f5-4d02b20ed142 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] 10.222.0.30 "GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd" status: 200 len: 1575 microversion: 2.1 time: 0.151986 Nov 02 14:57:54.504447 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 591/1153] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:57:54 2022] GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:57:55.118714 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [req-c80290e0-e2fd-42f9-9759-5d530ccf54c7 req-5fbb06cb-79e2-4103-90b0-fa6adf3fe9db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96021548-cde6-43f8-a4c2-4da1416b6bfd", "name": "network-vif-plugged", "status": "completed", "tag": "f268e93c-fd04-4d6b-809f-68b16158c800"}]} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:57:55.128965 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-c80290e0-e2fd-42f9-9759-5d530ccf54c7 req-5fbb06cb-79e2-4103-90b0-fa6adf3fe9db service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:55.131478 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-c80290e0-e2fd-42f9-9759-5d530ccf54c7 req-5fbb06cb-79e2-4103-90b0-fa6adf3fe9db service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:55.131478 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-c80290e0-e2fd-42f9-9759-5d530ccf54c7 req-5fbb06cb-79e2-4103-90b0-fa6adf3fe9db service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:55.141886 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.compute.server_external_events [req-c80290e0-e2fd-42f9-9759-5d530ccf54c7 req-5fbb06cb-79e2-4103-90b0-fa6adf3fe9db service nova] Creating event network-vif-plugged:f268e93c-fd04-4d6b-809f-68b16158c800 for instance 96021548-cde6-43f8-a4c2-4da1416b6bfd on hv-cinder-86236 Nov 02 14:57:55.147072 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [req-c80290e0-e2fd-42f9-9759-5d530ccf54c7 req-5fbb06cb-79e2-4103-90b0-fa6adf3fe9db service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032187 Nov 02 14:57:55.148710 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 563/1154] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:57:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:57:55.527362 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-e67bcbca-a62e-45d4-a2a6-edb393d5a462 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:55.528083 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-e67bcbca-a62e-45d4-a2a6-edb393d5a462 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] [instance: 96021548-cde6-43f8-a4c2-4da1416b6bfd] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:55.531200 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:57:55.535881 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e67bcbca-a62e-45d4-a2a6-edb393d5a462 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:55.536363 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e67bcbca-a62e-45d4-a2a6-edb393d5a462 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:55.536819 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e67bcbca-a62e-45d4-a2a6-edb393d5a462 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:55.537649 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e67bcbca-a62e-45d4-a2a6-edb393d5a462 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:55.538101 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e67bcbca-a62e-45d4-a2a6-edb393d5a462 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:55.538533 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-e67bcbca-a62e-45d4-a2a6-edb393d5a462 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:55.673877 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-e67bcbca-a62e-45d4-a2a6-edb393d5a462 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e2a8a810804aceb641c1bd752f35e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7940a345a7c4ccba03eff0476e82d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:57:55.681586 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-e67bcbca-a62e-45d4-a2a6-edb393d5a462 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] 10.222.0.30 "GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd" status: 200 len: 1575 microversion: 2.1 time: 0.158298 Nov 02 14:57:55.682155 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 592/1155] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:57:55 2022] GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:57:56.706048 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-61c60030-9966-4dfe-bb40-5c6df2fefdb4 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:56.706740 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-61c60030-9966-4dfe-bb40-5c6df2fefdb4 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] [instance: 96021548-cde6-43f8-a4c2-4da1416b6bfd] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:56.708660 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_api:SELECT=31 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:57:56.713536 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-61c60030-9966-4dfe-bb40-5c6df2fefdb4 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:56.714016 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-61c60030-9966-4dfe-bb40-5c6df2fefdb4 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:56.714451 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-61c60030-9966-4dfe-bb40-5c6df2fefdb4 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:56.715137 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-61c60030-9966-4dfe-bb40-5c6df2fefdb4 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:56.715586 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-61c60030-9966-4dfe-bb40-5c6df2fefdb4 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:56.716013 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-61c60030-9966-4dfe-bb40-5c6df2fefdb4 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:56.718739 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell1:SELECT=87 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:57:56.854420 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-61c60030-9966-4dfe-bb40-5c6df2fefdb4 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e2a8a810804aceb641c1bd752f35e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7940a345a7c4ccba03eff0476e82d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:57:56.860815 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-61c60030-9966-4dfe-bb40-5c6df2fefdb4 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] 10.222.0.30 "GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd" status: 200 len: 1562 microversion: 2.1 time: 0.160054 Nov 02 14:57:56.861336 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 564/1156] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:57:56 2022] GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd => generated 1562 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:59:10.203277 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_api:SELECT=1 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:59:10.203277 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG dbcounter [-] [119659] Writing DB stats nova_cell1:SELECT=10 {{(pid=119659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:59:10.207772 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_api:SELECT=1 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:59:10.208514 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG dbcounter [-] [119658] Writing DB stats nova_cell1:SELECT=5 {{(pid=119658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:59:10.209379 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 14:59:10.209524 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: Wed Nov 2 14:59:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.30) !!! Nov 02 14:59:10.216240 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-4a902978-4645-41fd-ae1a-4879be7925f5 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:59:10.216751 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-4a902978-4645-41fd-ae1a-4879be7925f5 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] [instance: 96021548-cde6-43f8-a4c2-4da1416b6bfd] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:59:10.224212 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4a902978-4645-41fd-ae1a-4879be7925f5 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:59:10.226906 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4a902978-4645-41fd-ae1a-4879be7925f5 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:59:10.226906 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4a902978-4645-41fd-ae1a-4879be7925f5 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:59:10.226906 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4a902978-4645-41fd-ae1a-4879be7925f5 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:59:10.226906 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4a902978-4645-41fd-ae1a-4879be7925f5 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:59:10.228273 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-4a902978-4645-41fd-ae1a-4879be7925f5 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:59:10.256712 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-4a902978-4645-41fd-ae1a-4879be7925f5 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] [instance: 96021548-cde6-43f8-a4c2-4da1416b6bfd] Going to try to terminate instance {{(pid=119659) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:59:10.298954 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [req-f182551e-6728-47b5-b031-05a511b6b99d req-06d823a4-8e48-44ef-862f-cc769dbb4415 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96021548-cde6-43f8-a4c2-4da1416b6bfd", "tag": "f268e93c-fd04-4d6b-809f-68b16158c800"}]} {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:59:10.308885 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-f182551e-6728-47b5-b031-05a511b6b99d req-06d823a4-8e48-44ef-862f-cc769dbb4415 service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:59:10.309341 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-f182551e-6728-47b5-b031-05a511b6b99d req-06d823a4-8e48-44ef-862f-cc769dbb4415 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:59:10.309785 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [req-f182551e-6728-47b5-b031-05a511b6b99d req-06d823a4-8e48-44ef-862f-cc769dbb4415 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:59:10.323258 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.compute.server_external_events [req-f182551e-6728-47b5-b031-05a511b6b99d req-06d823a4-8e48-44ef-862f-cc769dbb4415 service nova] Creating event network-changed:f268e93c-fd04-4d6b-809f-68b16158c800 for instance 96021548-cde6-43f8-a4c2-4da1416b6bfd on hv-cinder-86236 Nov 02 14:59:10.329735 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [req-f182551e-6728-47b5-b031-05a511b6b99d req-06d823a4-8e48-44ef-862f-cc769dbb4415 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123325 Nov 02 14:59:10.330524 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 565/1157] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:59:10.581032 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-4a902978-4645-41fd-ae1a-4879be7925f5 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] 10.222.0.30 "DELETE /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd" status: 204 len: 0 microversion: 2.1 time: 0.380916 Nov 02 14:59:10.581633 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 593/1158] 10.222.0.30 () {58 vars in 1239 bytes} [Wed Nov 2 14:59:10 2022] DELETE /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:59:10.591400 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-7544ad0f-f16d-45e3-a1e0-3010dab619df tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:59:10.592379 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-7544ad0f-f16d-45e3-a1e0-3010dab619df tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] [instance: 96021548-cde6-43f8-a4c2-4da1416b6bfd] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:59:10.600213 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7544ad0f-f16d-45e3-a1e0-3010dab619df tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:59:10.600808 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7544ad0f-f16d-45e3-a1e0-3010dab619df tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:59:10.601623 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7544ad0f-f16d-45e3-a1e0-3010dab619df tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:59:10.602629 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7544ad0f-f16d-45e3-a1e0-3010dab619df tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:59:10.603164 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7544ad0f-f16d-45e3-a1e0-3010dab619df tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:59:10.603666 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-7544ad0f-f16d-45e3-a1e0-3010dab619df tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:59:10.747755 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-7544ad0f-f16d-45e3-a1e0-3010dab619df tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e2a8a810804aceb641c1bd752f35e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7940a345a7c4ccba03eff0476e82d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:59:10.757236 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-7544ad0f-f16d-45e3-a1e0-3010dab619df tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] 10.222.0.30 "GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd" status: 200 len: 1568 microversion: 2.1 time: 0.170434 Nov 02 14:59:10.757822 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 566/1159] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:59:10 2022] GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:59:11.782085 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-81ea235a-8fa2-44f3-8338-2a19afaec97a tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:59:11.782700 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-81ea235a-8fa2-44f3-8338-2a19afaec97a tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] [instance: 96021548-cde6-43f8-a4c2-4da1416b6bfd] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:59:11.789316 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-81ea235a-8fa2-44f3-8338-2a19afaec97a tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:59:11.789806 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-81ea235a-8fa2-44f3-8338-2a19afaec97a tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:59:11.790460 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-81ea235a-8fa2-44f3-8338-2a19afaec97a tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:59:11.791174 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-81ea235a-8fa2-44f3-8338-2a19afaec97a tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:59:11.791628 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-81ea235a-8fa2-44f3-8338-2a19afaec97a tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:59:11.792059 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-81ea235a-8fa2-44f3-8338-2a19afaec97a tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:59:11.929051 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.policy [None req-81ea235a-8fa2-44f3-8338-2a19afaec97a tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e2a8a810804aceb641c1bd752f35e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7940a345a7c4ccba03eff0476e82d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119659) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:59:11.941275 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-81ea235a-8fa2-44f3-8338-2a19afaec97a tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] 10.222.0.30 "GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd" status: 200 len: 1568 microversion: 2.1 time: 0.163867 Nov 02 14:59:11.941865 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 594/1160] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:59:11 2022] GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:59:12.963368 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-e6a9386c-9de7-4174-815d-9ab1dda80194 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:59:12.963979 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-e6a9386c-9de7-4174-815d-9ab1dda80194 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] [instance: 96021548-cde6-43f8-a4c2-4da1416b6bfd] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:59:12.971253 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e6a9386c-9de7-4174-815d-9ab1dda80194 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:59:12.971740 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e6a9386c-9de7-4174-815d-9ab1dda80194 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:59:12.972179 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e6a9386c-9de7-4174-815d-9ab1dda80194 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:59:12.972935 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e6a9386c-9de7-4174-815d-9ab1dda80194 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:59:12.973414 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e6a9386c-9de7-4174-815d-9ab1dda80194 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:59:12.973840 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-e6a9386c-9de7-4174-815d-9ab1dda80194 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:59:13.037688 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-e6a9386c-9de7-4174-815d-9ab1dda80194 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e2a8a810804aceb641c1bd752f35e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7940a345a7c4ccba03eff0476e82d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:59:13.047904 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-e6a9386c-9de7-4174-815d-9ab1dda80194 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] 10.222.0.30 "GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd" status: 200 len: 1382 microversion: 2.1 time: 0.088374 Nov 02 14:59:13.048831 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 567/1161] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:59:12 2022] GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd => generated 1382 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:59:13.101870 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [req-edf54720-a305-48f6-b88b-69873c514661 req-486e0f41-181c-40f6-8827-310848cac375 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96021548-cde6-43f8-a4c2-4da1416b6bfd", "name": "network-vif-deleted", "tag": "f268e93c-fd04-4d6b-809f-68b16158c800"}]} {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:59:13.112304 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-edf54720-a305-48f6-b88b-69873c514661 req-486e0f41-181c-40f6-8827-310848cac375 service nova] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:59:13.112778 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-edf54720-a305-48f6-b88b-69873c514661 req-486e0f41-181c-40f6-8827-310848cac375 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:59:13.113243 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [req-edf54720-a305-48f6-b88b-69873c514661 req-486e0f41-181c-40f6-8827-310848cac375 service nova] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:59:13.124572 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.compute.server_external_events [req-edf54720-a305-48f6-b88b-69873c514661 req-486e0f41-181c-40f6-8827-310848cac375 service nova] Creating event network-vif-deleted:f268e93c-fd04-4d6b-809f-68b16158c800 for instance 96021548-cde6-43f8-a4c2-4da1416b6bfd on hv-cinder-86236 Nov 02 14:59:13.129666 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [req-edf54720-a305-48f6-b88b-69873c514661 req-486e0f41-181c-40f6-8827-310848cac375 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031810 Nov 02 14:59:13.130264 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 595/1162] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Nov 2 14:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:59:14.070749 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-6b4422cd-b6c2-4389-b02a-dc78af250a98 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Calling method '>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:59:14.071334 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.compute.api [None req-6b4422cd-b6c2-4389-b02a-dc78af250a98 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] [instance: 96021548-cde6-43f8-a4c2-4da1416b6bfd] Fetching instance by UUID {{(pid=119658) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:59:14.078147 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6b4422cd-b6c2-4389-b02a-dc78af250a98 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:59:14.078635 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6b4422cd-b6c2-4389-b02a-dc78af250a98 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:59:14.079082 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6b4422cd-b6c2-4389-b02a-dc78af250a98 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:59:14.079787 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6b4422cd-b6c2-4389-b02a-dc78af250a98 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:59:14.080256 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6b4422cd-b6c2-4389-b02a-dc78af250a98 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:59:14.080690 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6b4422cd-b6c2-4389-b02a-dc78af250a98 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:59:14.112756 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6b4422cd-b6c2-4389-b02a-dc78af250a98 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:59:14.113295 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6b4422cd-b6c2-4389-b02a-dc78af250a98 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:59:14.113751 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG oslo_concurrency.lockutils [None req-6b4422cd-b6c2-4389-b02a-dc78af250a98 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:59:14.114220 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.objects.instance [None req-6b4422cd-b6c2-4389-b02a-dc78af250a98 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lazy-loading 'fault' on Instance uuid 96021548-cde6-43f8-a4c2-4da1416b6bfd {{(pid=119658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:59:14.157801 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.policy [None req-6b4422cd-b6c2-4389-b02a-dc78af250a98 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e2a8a810804aceb641c1bd752f35e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7940a345a7c4ccba03eff0476e82d6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119658) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:59:14.165941 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-6b4422cd-b6c2-4389-b02a-dc78af250a98 tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] 10.222.0.30 "GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd" status: 200 len: 1224 microversion: 2.1 time: 0.099129 Nov 02 14:59:14.166522 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 568/1163] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:59:14 2022] GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd => generated 1224 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:59:15.192179 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-a61ca17d-26ba-4dc6-a1b4-845adabcf91b tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Calling method '>' {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:59:15.192802 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.compute.api [None req-a61ca17d-26ba-4dc6-a1b4-845adabcf91b tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] [instance: 96021548-cde6-43f8-a4c2-4da1416b6bfd] Fetching instance by UUID {{(pid=119659) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:59:15.198975 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a61ca17d-26ba-4dc6-a1b4-845adabcf91b tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:59:15.199453 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a61ca17d-26ba-4dc6-a1b4-845adabcf91b tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:59:15.199889 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a61ca17d-26ba-4dc6-a1b4-845adabcf91b tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:59:15.200568 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a61ca17d-26ba-4dc6-a1b4-845adabcf91b tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Acquiring lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:59:15.201037 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a61ca17d-26ba-4dc6-a1b4-845adabcf91b tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:59:15.201463 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG oslo_concurrency.lockutils [None req-a61ca17d-26ba-4dc6-a1b4-845adabcf91b tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Lock "8d61f910-ccfe-4a5e-a533-9675eb6757f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:59:15.215192 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.wsgi [None req-a61ca17d-26ba-4dc6-a1b4-845adabcf91b tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] HTTP exception thrown: Instance 96021548-cde6-43f8-a4c2-4da1416b6bfd could not be found. Nov 02 14:59:15.216791 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-a61ca17d-26ba-4dc6-a1b4-845adabcf91b tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Request method failure captured: Nov 02 14:59:15.216791 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: request: GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd HTTP/1.1 Nov 02 14:59:15.216791 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Accept: application/json Nov 02 14:59:15.216791 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Accept-Encoding: identity Nov 02 14:59:15.216791 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Connection: close Nov 02 14:59:15.216791 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Content-Length: 0 Nov 02 14:59:15.216791 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Content-Type: application/json Nov 02 14:59:15.216791 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Host: 10.222.0.30 Nov 02 14:59:15.216791 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: Openstack-System-Scope: None Nov 02 14:59:15.216791 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: User-Agent: python-urllib3/1.26.12 Nov 02 14:59:15.216791 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Auth-Token: gAAAAABjYoSwtDSCbTYD5rM8bY7oHqc6YrwJXdagRsr0de0OFkWwQ8x0y2SAO4ic12ib81rNpaTt5O7ozGzRCvvWlQRBA2AeQgQEGN8GfEs3Xn1S4pmXtPmrnYi0Z_0IPnzB1_s9NAI8VdNufKsiIlTlPqKpD-B8fCvdMA9sdxuIxtd-iq2QQ8I Nov 02 14:59:15.216791 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Domain-Id: None Nov 02 14:59:15.216791 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Domain-Name: None Nov 02 14:59:15.216791 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Identity-Status: Confirmed Nov 02 14:59:15.216791 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Is-Admin-Project: True Nov 02 14:59:15.216791 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Domain-Id: default Nov 02 14:59:15.216791 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Domain-Name: Default Nov 02 14:59:15.216791 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Id: b7940a345a7c4ccba03eff0476e82d6c Nov 02 14:59:15.216791 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Project-Name: tempest-TestShelveInstance-280909676 Nov 02 14:59:15.216791 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Role: reader,member Nov 02 14:59:15.216791 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Roles: reader,member Nov 02 14:59:15.218655 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b7940a345a7c4ccba03eff0476e82d6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b7940a345a7c4ccba03eff0476e82d6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b7940a345a7c4ccba03eff0476e82d6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b7940a345a7c4ccba03eff0476e82d6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Nov 02 14:59:15.218655 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant: tempest-TestShelveInstance-280909676 Nov 02 14:59:15.218655 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant-Id: b7940a345a7c4ccba03eff0476e82d6c Nov 02 14:59:15.218655 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-Tenant-Name: tempest-TestShelveInstance-280909676 Nov 02 14:59:15.218655 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User: tempest-TestShelveInstance-280909676-project Nov 02 14:59:15.218655 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Domain-Id: default Nov 02 14:59:15.218655 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Domain-Name: Default Nov 02 14:59:15.218655 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Id: e5e2a8a810804aceb641c1bd752f35e3 Nov 02 14:59:15.218655 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: X-User-Name: tempest-TestShelveInstance-280909676-project Nov 02 14:59:15.218655 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: method: > Nov 02 14:59:15.218655 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: exception: Instance 96021548-cde6-43f8-a4c2-4da1416b6bfd could not be found. Nov 02 14:59:15.218655 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: action_args: {'id': '96021548-cde6-43f8-a4c2-4da1416b6bfd'} Nov 02 14:59:15.219718 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: {{(pid=119659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:59:15.219718 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:59:15.219718 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:59:15.219718 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:59:15.219718 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:59:15.219718 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:59:15.219718 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:59:15.219718 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:59:15.219718 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:59:15.219718 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:59:15.219718 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96021548-cde6-43f8-a4c2-4da1416b6bfd could not be found. Nov 02 14:59:15.219718 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:59:15.219718 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:59:15.219718 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:59:15.219718 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:59:15.219718 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:59:15.219718 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:59:15.219718 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:59:15.219718 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:59:15.219718 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:59:15.221455 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:59:15.221455 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:59:15.221455 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:59:15.221455 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:59:15.221455 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:59:15.221455 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:59:15.221455 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:59:15.221455 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96021548-cde6-43f8-a4c2-4da1416b6bfd could not be found. Nov 02 14:59:15.221455 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:59:15.221455 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:59:15.221455 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:59:15.221455 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:59:15.221455 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:59:15.221455 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:59:15.221455 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:59:15.221455 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:59:15.221455 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96021548-cde6-43f8-a4c2-4da1416b6bfd could not be found. Nov 02 14:59:15.221455 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: ERROR nova.api.openstack.wsgi Nov 02 14:59:15.222995 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: DEBUG nova.api.openstack.wsgi [None req-a61ca17d-26ba-4dc6-a1b4-845adabcf91b tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Returning 404 to user: Instance 96021548-cde6-43f8-a4c2-4da1416b6bfd could not be found. {{(pid=119659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:59:15.222995 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: INFO nova.api.openstack.requestlog [None req-a61ca17d-26ba-4dc6-a1b4-845adabcf91b tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] 10.222.0.30 "GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd" status: 404 len: 111 microversion: 2.1 time: 0.030978 Nov 02 14:59:15.222995 dv-cinder-862365-4-iscsi devstack@n-api.service[119659]: [pid: 119659|app: 0|req: 596/1164] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Nov 2 14:59:15 2022] GET /compute/v2.1/servers/96021548-cde6-43f8-a4c2-4da1416b6bfd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:59:15.453891 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: DEBUG nova.api.openstack.wsgi [None req-37a6e16f-6913-493d-8a0e-627446ccb3aa tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] Calling method '.version_select at 0x7fb24ed745e0>' {{(pid=119658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:59:15.553461 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: INFO nova.api.openstack.requestlog [None req-37a6e16f-6913-493d-8a0e-627446ccb3aa tempest-TestShelveInstance-280909676 tempest-TestShelveInstance-280909676-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2067260031" status: 202 len: 0 microversion: 2.1 time: 0.103339 Nov 02 14:59:15.554047 dv-cinder-862365-4-iscsi devstack@n-api.service[119658]: [pid: 119658|app: 0|req: 569/1165] 10.222.0.30 () {58 vars in 1254 bytes} [Wed Nov 2 14:59:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2067260031 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)